麻烦在VSCode中运行pyspark的例子

问题描述

我试图关注：https：//docs.microsoft.com/en-us/azure/hdinsight/hdinsight-for-vscode

Hive示例工作正常，但我遇到了pyspark，PySPark Interactive和Batch throw错误。我将专注于互动：

第一期我遇到了是"无法导入名称DataError"。在搜索后我发现我必须降级大熊猫0.20.0，这意味着将python降级到3.6。请将此指定为要求。

然后我遇到第二个问题我需要帮助：

由于致命错误导致代码失败：

    来自https://xxx.azurehdinsight.net//livy/sessions的状态代码为"400"，错误有效负载："无效种类：pyspark3（通过参考链：org.apache.livy.server.interactive.CreateInteractiveRequest [ \"kind \"]）"。

谢谢，

Lukasz

解决方案

Hi,

I've tried to follow:https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-for-vscode

Hive examples worked fine, but I had trouble with pyspark, both PySPark Interactive and Batch throw errors. I'll focus on interactive:

1st issue I ran into was "cannot import name DataError". After searching around I found out that I have to downgrade pandas 0.20.0, which meant downgrading python to 3.6. Please specify this as requirement.

Then I've encountered 2nd issue I need help with:

The code failed because of a fatal error:
    Invalid status code '400' from https://xxx.azurehdinsight.net//livy/sessions with error payload: "Invalid kind: pyspark3 (through reference chain: org.apache.livy.server.interactive.CreateInteractiveRequest[\"kind\"])".

Thanks,

Lukasz

解决方案

这篇关于麻烦在VSCode中运行pyspark的例子的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！