Role
Master, Worker, Client, Driver, Executor
Concept
RpcCallContext
- NettyRpcCallContext(LocalNettyRpcCallContext, RemoteNettyRpcCallContext)
RpcEnv
NettyRpcEnv(NettyRpcHandler)
RpcEnvConfig(SparkConf)
RpcEnvFileServer(NettyStreamManager<jars, files, directories>)
RpcEnvFactory
- NettyRpcEnvFactory
RpcEndpoint
ThreadSafeRpcEndpoint(Master, Worker, ClientEndpoint, DriverEndpoint, HeartbeatReceiver, BlockManagerMasterEndpoint, BlockManagerSlaveEndpoint)
RpcEndpointVerifier
RpcEndpointRef
- NettyRpcEndpointRef
Dispatcher
EndpointData
MessageLoop
Inbox
- InboxMessage
Outbox
- OutboxMessage
Others
- Message, MessageEncoder, MessageDecoder
- RpcAddress, RpcTimeout
- Reactor, Proactor
Links
- Author：HyperJ
- Source：HyperJ’s Blog
- Link：Spark Network