大数据之ApacheBeam使用FlinkRunner管道参数

例子

Flink集群

mvn package exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--runner=FlinkRunner --flinkMaster=<flink master> --filesToStage=target/word-count-beam-bundled-0.1.jar --inputFile=/path/to/quickstart/pom.xml --output=/tmp/counts" -Pflink-runner

管道参数说明

在丘北等地区，都构建了全面的区域性战略布局，加强发展的系统性、市场前瞻性、产品创新能力，以专注、极致的服务理念，为客户提供网站建设、做网站网站设计制作按需搭建网站,公司网站建设,企业网站建设,高端网站设计,全网营销推广,外贸网站制作,丘北网站建设费用合理。

Field	Description	Default Value
`runner`	The pipeline runner to use. This option allows you to determine the pipeline runner at runtime.	Set to `FlinkRunner`to run using Flink.
`streaming`	Whether streaming mode is enabled or disabled; `true` if enabled. Set to `true` if running pipelines with unbounded `PCollection`s.	`false`
`flinkMaster`	The url of the Flink JobManager on which to execute pipelines. This can either be the address of a cluster JobManager, in the form `"host:port"` or one of the special Strings `"[local]"` or `"[auto]"`. `"[local]"` will start a local Flink Cluster in the JVM while `"[auto]"` will let the system decide where to execute the pipeline based on the environment.	`[auto]`
`filesToStage`	Jar Files to send to all workers and put on the classpath. Here you have to put the fat jar that contains your program along with all dependencies.	empty
`parallelism`	The degree of parallelism to be used when distributing operations onto workers.	`1`
`checkpointingInterval`	The interval between consecutive checkpoints (i.e. snapshots of the current pipeline state used for fault tolerance).	`-1L`, i.e. disabled
`numberOfExecutionRetries`	Sets the number of times that failed tasks are re-executed. A value of `0` effectively disables fault tolerance. A value of `-1` indicates that the system default value (as defined in the configuration) should be used.	`-1`
`executionRetryDelay`	Sets the delay between executions. A value of `-1` indicates that the default value should be used.	`-1`
`stateBackend`	Sets the state backend to use in streaming mode. The default is to read this setting from the Flink config.	`empty`, i.e. read from Flink config

网页标题：大数据之ApacheBeam使用FlinkRunner管道参数
文章路径：https://www.cdcxhl.com/article36/pgdopg.html

成都网站建设公司_创新互联，为您提供响应式网站、域名注册、服务器托管、网站设计公司、电子商务、网站收录

声明：本网站发布的内容（图片、视频和文字）以用户投稿、用户转载内容为主，如果涉及侵权请尽快告知，我们将会在第一时间删除。文章观点不代表本网站立场，如需处理请联系客服。电话：028-86922220；邮箱：631063699@qq.com。内容未经允许不得转载，或转载时需注明来源：创新互联

猜你还喜欢下面的内容