Spark疑问2之spark 丢了executor会恢复吗

发布网友发布时间：2022-05-23 14:57

共1个回答

热心网友时间：2023-10-26 05:21

Spark疑问2之spark 丢了executor会恢复吗 Lost executor

[plain] view plain copy
hadoop@Master:~/cloud/testByXubo/spark/GRCH38/test2$ ./cluster.sh
fq0.count:45850077
Method 3=> Length:321202 sum3:3.209457928E9 time:236360ms
[Stage 5:=============================> (13 + 12) / 25]16/04/17 15:11:17 ERROR TaskSchelerImpl: Lost executor 2 on 219.219.220.149: Executor heartbeat timed out after 144594 ms
[Stage 5:=============================> (2 + 2) / 4]16/04/17 15:16:42 ERROR TaskSchelerImpl: Lost executor 5 on 219.219.220.233: remote Rpc client disassociated
16/04/17 15:16:43 ERROR TaskSchelerImpl: Lost executor 3 on 219.219.220.131: remote Rpc client disassociated

声明：本网页内容为用户发布，旨在传播知识，不代表本网认同其观点，若有侵权等问题请及时与本网联系，我们将在第一时间删除处理。E-MAIL:11247931@qq.com