如何在 map-reduce 的多重输入中将虚拟变量设置为路径
how to set dummy variable as path in multipleinput in map-reduce
我已经使用 scan 将 hbase table 数据传递给映射器。有什么方法可以在 MultipleInput()
中将虚拟路径或变量设置为路径参数
List<Scan> scans = new ArrayList();
scans.add(data);
TableMapReduceUtils.initTableMapperJob(scans, Mapper.class,
ImmutalbeWriteable.class, ImmutalbeWriteable.class, job);
MultipleInputs.addInputPath(job, new Path("DUMMY"),
SequenceFileInputFormat.class, Mapper.class)
I'm getting error: This path doesn't exits, while passing DUMMY
variable in path like this.
MultipleInputs.addInputPath(job, new Path("DUMMY"),
MultiTableInputFormat.class, Mapper.class)
我已经使用 scan 将 hbase table 数据传递给映射器。有什么方法可以在 MultipleInput()
List<Scan> scans = new ArrayList();
scans.add(data);
TableMapReduceUtils.initTableMapperJob(scans, Mapper.class,
ImmutalbeWriteable.class, ImmutalbeWriteable.class, job);
MultipleInputs.addInputPath(job, new Path("DUMMY"),
SequenceFileInputFormat.class, Mapper.class)
I'm getting error: This path doesn't exits, while passing
DUMMYvariable in path like this.
MultipleInputs.addInputPath(job, new Path("DUMMY"),
MultiTableInputFormat.class, Mapper.class)