How to load this big size hadoop file?
I need to load some files from hadoop to local USB.
One file in a directory is strange, it only has a name "-", and the size of it is over 45G. I first use "hadoop fs -get" to get the data to local linux VM, and then use WinSCP to load the data to local USB. But my local Linux VM's capacity is only 19G. How to do this?
I am thinking about splitting the 45G file to smaller files using hadoop command. But I have not found such command.