Spark疑问2之spark 丢了executor会恢复吗
发布网友
发布时间:2022-05-23 14:57
我来回答
共1个回答
热心网友
时间:2023-10-26 05:21
Spark疑问2之spark 丢了executor会恢复吗 Lost executor
[plain] view plain copy
hadoop@Master:~/cloud/testByXubo/spark/GRCH38/test2$ ./cluster.sh
fq0.count:45850077
Method 3=> Length:321202 sum3:3.209457928E9 time:236360ms
[Stage 5:=============================> (13 + 12) / 25]16/04/17 15:11:17 ERROR TaskSchelerImpl: Lost executor 2 on 219.219.220.149: Executor heartbeat timed out after 144594 ms
[Stage 5:=============================> (2 + 2) / 4]16/04/17 15:16:42 ERROR TaskSchelerImpl: Lost executor 5 on 219.219.220.233: remote Rpc client disassociated
16/04/17 15:16:43 ERROR TaskSchelerImpl: Lost executor 3 on 219.219.220.131: remote Rpc client disassociated