dfs.block.size has no influence on the performance of TeraGen

I changed the dfs.block.size from 64MB to 1MB in the hdfs-size.xml, and run teragen to explore the influence on job performance. However, the number of map tasks was not changed (I think it should become large, since it is equal with the file size/block size). Also, the time needed to complete the job is almost the same. Is it normal?

Answers


TeraGen is for generation of data. So basically this works off no input to generate data for TeraSort.

So basically no. of mappers is not influenced by block size in this case.


Need Your Help

How to get an a tag hover to also work on wrapped span

html css

I have a span tag that has a background image on it then inside it I have an a tag with text link. The span has the background image set to the right of the text link. I want when you rollover the ...

OpenLayers.Control.Scale fails if parameters are specified

parameters controls scale openlayers

In OpenLayers 2.13.1, map.addControl(new OpenLayers.Control.Scale({ geodesic: true })); fails (scale not visible in the map), if no parameters are specified scale control works OK.