本文介绍了Nutch 2.3和HBase 1.0.0的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我尝试实现nutch,以便抓取数百万个URL,实际上它似乎可以在本地使用HBase 0.94。



但是,已安装的群集HBase 1.0.0,但我们没有成功。



实际上可以在HBase 1.0.0中使用nutch 2.3吗?



感谢您的解答。 HBase0.94和HBase1 .0.0不向后兼容。所以,如果你有用HBase0.94编译的代码,那么它不会与HBase1.0.0集群一起工作。只需用HBase1.0.0重新编译你的代码,然后它就可以工作。您可能需要对HBaseClient进行微小的代码更改。



此外,HBase不支持HBase0.94。


I try to implement nutch for a projet that will crawl millions urls and actually it seems to work with HBase 0.94 locally.

But the cluster in place is installed with HBase 1.0.0 and we didn't manage to make it works.

Is it actually possible to use nutch 2.3 with HBase 1.0.0 ?

Thanks for the answers.

解决方案

HBase0.94 and HBase1.0.0 are not backward compatible. So, if you have code compiled with HBase0.94 then it wont work out of box with HBase1.0.0 cluster. Just recompile your code with HBase1.0.0 and then it should work. You might need to do minor code changes in HBaseClient.

Also, HBase0.94 is not supported by HBase now.

这篇关于Nutch 2.3和HBase 1.0.0的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持!

10-28 22:04