学无先后,达者为师

网站首页 编程语言 正文

ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:error processing WRITE_BLOCK operation src

作者:从零开始的数据猿 更新时间: 2022-05-13 编程语言

Error:

DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Solution:

1.修改进程最大文件打开数

sudo vim /etc/security/limits.conf

End of file

*           -      nofile          1000000
*           -      nproc           1000000

2.修改数据传输线程个数

hdfs-site.xml

in hadoop-1.x



dfs.datanode.max.xcievers

8192

 

Specifies the maximum number of threads to use for transferring data

  in and out of the DN.




in hadoop-2.x



dfs.datanode.max.transfer.threads

 8192



Specifies the maximum number of threads to use for transferring data

 in and out of the DN.




参考:https://huangkx.blog.csdn.net/article/details/21240247

原文链接:https://nmydt.blog.csdn.net/article/details/124582951

栏目分类
最近更新