阿里云E-MapReduce中在spark里使用jingdo访问oss，出现400 请求错误，是啥原因？ spark-3.4.2, jindosdk-6.3.0. 谢谢。是版本问题么？24/02/20 13:40:57 INFO SQLHadoopMapReduceCommitProtocol: Using output committer class org.apache.hadoop......

问答 2024-01-23 来自：开发者社区

请问阿里云E-MapReduce OSS-HDFS 有什么简便的方法创建目录结构嘛？

"阿里云E-MapReduce的OSS-HDFS中，是否有便捷的方法来创建目录结构，因为在控制台上没有找到创建目录的选项？此外，在macOS M2架构上部署JindoSDK时遇到错误，是否是由于架构不兼容所导致的？https://github.com/aliyun/alibabacloud-jindodata/blob/bea402b935b1c56168612c771df7670cd4c386....

问答 2024-01-17 来自：开发者社区

阿里云E-MapReduce的jindodata写数据到oss，是单线程还是多线程阿？

问答 2024-01-09 来自：开发者社区

阿里云E-MapReduce现在用jindo-distcp实现hdfs到oss数据同步，完全同步吧？

阿里云E-MapReduce中，想用jindo-distcp实现hdfs到oss数据同步，现在oss数据由于变为归档类型的了，有60天不得删除的限制，所以同步的时候，想让变更的hdfs数据到另外的oss目录去，原来的oss目录下数据能保持不动，该如何实现呢？

问答 2023-12-25 来自：开发者社区

阿里云E-MapReduce jindodistcp迁移hdfs到oss的时候会忽略正在写入的块么？

阿里云E-MapReduce jindodistcp迁移hdfs到oss的时候会忽略正在写入的块么?

共有26条

< 1 2 3 >

跳转至： GO

更新时间 2024-07-18 14:26:50

本页面内关键词为智能算法引擎基于机器学习所生成，如有任何问题，可在页面下方点击"联系我们"与我们沟通。

开源大数据平台 E-MapReduce您可能感兴趣

产品推荐

{"moduleinfo":{"card_count":[{"count_phone":1,"count":1}],"search_count":[{"count_phone":3,"count":3}]},"card":[{"des":"E-MapReduce 是构建于阿里云ECS弹性虚拟机之上，利用开源大数据生态系统，包括Hadoop，Spark，Kafka，Storm，为用户提供集群，作业，数据等管理的一站式大数据处理分析业务。","link1":"https://www.aliyun.com/product/emr","link":"https://www.aliyun.com/product/emr","icon":"https://img.alicdn.com/tfs/TB10yI6DNn1gK0jSZKPXXXvUXXa-201-200.png","btn2":"产品文档","tip":"海量存储，离线计算，实时计算场景等各种场景，Hadoop，Spark，Hive，Kafka，Storm等集群快速购买，<a href=\"https://www.aliyun.com/product/emapreduce\" target=\"_blank\">立即查看</a>产品动态发布：<a href=\"https://www.aliyun.com/product/new\" target=\"_blank\">立即查看</a>","btn1":"立即开通","link2":"https://help.aliyun.com/document_detail/28068.html","title":"E-MapReduce"}],"search":[{"txt":"购买建议","link":"https://help.aliyun.com/document_detail/65683.html"},{"txt":"集群规划","link":"https://help.aliyun.com/document_detail/58901.html"},{"txt":"Spark开发入门","link":"https://help.aliyun.com/document_detail/28116.html"},{"txt":"快速入门","link":"https://help.aliyun.com/document_detail/43753.html"},{"txt":"产品动态","link":"https://www.aliyun.com/product/new"}],"countinfo":{"search":{"length_pc":0,"length":0},"card":{"length_pc":0,"length":0}},"simplifiedDisplay":"newEdition","newCard":[{"link":"https://www.aliyun.com/product/emapreduce","icon":"emapreduce","contentLink":"https://www.aliyun.com/product/emapreduce?spm=5176.19720258.J_8058803260.198.4d7a2c4aDND26z","title":"开源大数据平台 E-MapReduce","des":"开源大数据平台 E-MapReduce（简称“EMR”）是云原生开源大数据平台，向客户提供简单易集成的Hadoop、Hive、Spark、Flink、Presto、ClickHouse、StarRocks、Delta、Hudi等开源大数据计算和存储引擎服务。","btn1":"产品控制台","link1":"https://emr-next.console.aliyun.com/","btn2":"立即开通","link2":"https://emr-next.console.aliyun.com/#/create/ecs","btn3":"产品文档","link3":"https://help.aliyun.com/document_detail/28068.html","infoGroup":[{"infoName":"优惠活动","infoContent":{"firstContentName":"StarRocks 免费试用","firstContentLink":"https://free.aliyun.com/?pipCode=emapreduce&spm=5176.28055625.J_4VYgf18xNlTAyFFbOuOQe.118.e939154awRTC1N&scm=20140722.M_9821919._.V_1"}},{"infoName":"产品入门","infoContent":{"firstContentName":"快速入门指导","firstContentLink":"https://help.aliyun.com/document_detail/176795.html?spm=a2c4g.11186623.6.572.68403b8bI3rak8","lastContentName":"常见问题","lastContentLink":"https://help.aliyun.com/document_detail/28186.html?spm=a2c4g.11186623.6.1143.7bce1c52WiJTBt"}},{"infoName":"最佳实践","infoContent":{"firstContentName":"EMR实时计算实践","firstContentLink":"https://help.aliyun.com/document_detail/127198.html?spm=5176.cnemapreduce.0.0.3dd23a1cfXWfSP","lastContentName":"EMR弹性计算实践","lastContentLink":"https://bp.aliyun.com/front/home/detail/36?spm=5176.cnemapreduce.0.0.3dd23a1cfXWfSP"}},{"infoContent":{"lastContentName":"","lastContentLink":"","firstContentName":"产品最新动态","firstContentLink":"https://www.aliyun.com/product/new?category=19&product=125"},"infoName":"最新动态"}],"ifIcon":"icon","iconImg":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png"}]}

{"$env":{"JSON":{}},"$page":{"env":"production"},"$context":{"moduleinfo":{"card_count":[{"count_phone":1,"count":1}],"search_count":[{"count_phone":3,"count":3}]},"card":[{"des":"E-MapReduce 是构建于阿里云ECS弹性虚拟机之上，利用开源大数据生态系统，包括Hadoop，Spark，Kafka，Storm，为用户提供集群，作业，数据等管理的一站式大数据处理分析业务。","link1":"https://www.aliyun.com/product/emr","link":"https://www.aliyun.com/product/emr","icon":"https://img.alicdn.com/tfs/TB10yI6DNn1gK0jSZKPXXXvUXXa-201-200.png","btn2":"产品文档","tip":"海量存储，离线计算，实时计算场景等各种场景，Hadoop，Spark，Hive，Kafka，Storm等集群快速购买，<a href=\"https://www.aliyun.com/product/emapreduce\" target=\"_blank\">立即查看</a>产品动态发布：<a href=\"https://www.aliyun.com/product/new\" target=\"_blank\">立即查看</a>","btn1":"立即开通","link2":"https://help.aliyun.com/document_detail/28068.html","title":"E-MapReduce"}],"search":[{"txt":"购买建议","link":"https://help.aliyun.com/document_detail/65683.html"},{"txt":"集群规划","link":"https://help.aliyun.com/document_detail/58901.html"},{"txt":"Spark开发入门","link":"https://help.aliyun.com/document_detail/28116.html"},{"txt":"快速入门","link":"https://help.aliyun.com/document_detail/43753.html"},{"txt":"产品动态","link":"https://www.aliyun.com/product/new"}],"countinfo":{"search":{"length_pc":0,"length":0},"card":{"length_pc":0,"length":0}},"simplifiedDisplay":"newEdition","newCard":[{"link":"https://www.aliyun.com/product/emapreduce","icon":"emapreduce","contentLink":"https://www.aliyun.com/product/emapreduce?spm=5176.19720258.J_8058803260.198.4d7a2c4aDND26z","title":"开源大数据平台 E-MapReduce","des":"开源大数据平台 E-MapReduce（简称“EMR”）是云原生开源大数据平台，向客户提供简单易集成的Hadoop、Hive、Spark、Flink、Presto、ClickHouse、StarRocks、Delta、Hudi等开源大数据计算和存储引擎服务。","btn1":"产品控制台","link1":"https://emr-next.console.aliyun.com/","btn2":"立即开通","link2":"https://emr-next.console.aliyun.com/#/create/ecs","btn3":"产品文档","link3":"https://help.aliyun.com/document_detail/28068.html","infoGroup":[{"infoName":"优惠活动","infoContent":{"firstContentName":"StarRocks 免费试用","firstContentLink":"https://free.aliyun.com/?pipCode=emapreduce&spm=5176.28055625.J_4VYgf18xNlTAyFFbOuOQe.118.e939154awRTC1N&scm=20140722.M_9821919._.V_1"}},{"infoName":"产品入门","infoContent":{"firstContentName":"快速入门指导","firstContentLink":"https://help.aliyun.com/document_detail/176795.html?spm=a2c4g.11186623.6.572.68403b8bI3rak8","lastContentName":"常见问题","lastContentLink":"https://help.aliyun.com/document_detail/28186.html?spm=a2c4g.11186623.6.1143.7bce1c52WiJTBt"}},{"infoName":"最佳实践","infoContent":{"firstContentName":"EMR实时计算实践","firstContentLink":"https://help.aliyun.com/document_detail/127198.html?spm=5176.cnemapreduce.0.0.3dd23a1cfXWfSP","lastContentName":"EMR弹性计算实践","lastContentLink":"https://bp.aliyun.com/front/home/detail/36?spm=5176.cnemapreduce.0.0.3dd23a1cfXWfSP"}},{"infoContent":{"lastContentName":"","lastContentLink":"","firstContentName":"产品最新动态","firstContentLink":"https://www.aliyun.com/product/new?category=19&product=125"},"infoName":"最新动态"}],"ifIcon":"icon","iconImg":"https://img.alicdn.com/tfs/TB1XY8hGYr1gK0jSZFDXXb9yVXa-1740-328.png"}]}}

开源大数据平台 E-MapReduce

开源大数据平台 E-MapReduce（简称“EMR”）是云原生开源大数据平台，向客户提供简单易集成的Hadoop、Hive、Spark、Flink、Presto、ClickHouse、StarRocks、Delta、Hudi等开源大数据计算和存储引擎服务。

产品控制台

立即开通

产品文档

优惠活动

StarRocks 免费试用

产品入门

快速入门指导

常见问题

最佳实践

EMR实时计算实践