RImpala:较大数据时查询失败

本文介绍了RImpala:较大数据时查询失败的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

check1<-rimpala.query("select * from sum2")
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,  :
  java.sql.SQLException: Method not supported

dim(sum2)是49501行和18列.

check1<-rimpala.query("select *from sum3")

dim(sum3)是102行6列.

它以较小的样本量工作.

抱歉，我无法为此复制示例.有人在更大数据量时遇到同样的问题吗?有解决的办法吗?谢谢.

解决方案

如，RImpala没有实现executeUpdate，因此无法运行任何修改状态的查询.我怀疑您不是通过运行较大的SELECT查询而遇到错误，而是因为您尝试插入，更新或删除一些数据.

如果您想使用R中的Impala，建议您使用 dplyrimpaladb . /p>

check1<-rimpala.query("select * from sum2")
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,  :
  java.sql.SQLException: Method not supported

dim(sum2) is 49501 rows and 18 columns.

check1<-rimpala.query("select *from sum3")

dim(sum3) is 102 rows and 6 columns.

It worked with smaller sample size.

sorry that I cant reproduce example to this. Is anyone encounter the same problem with larger data size? Any idea to solve this? Thanks.

解决方案

As noted elsewhere on StackOverflow, RImpala does not implement executeUpdate and so cannot run any query that modifies state. I suspect you hit your error not by running a larger SELECT query but rather because you tried to insert, update, or delete some data.

If you'd like to use Impala from R, I'd recommend using dplyrimpaladb.

这篇关于RImpala:较大数据时查询失败的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！