java - Hadoop MapReduce producing log files only after certain interval? -


so have been trying run hadoop mapreduce job while, , after started running (all errors sorted out), wanted check log files stdout captured in log files, somehow see log files aren't being generated every time. (some times comes, other time doesn't)

i using output directory (/user/hduser/output_dir), , deleting contents , using again (to avoid keeping track of many output directories) log files indicate time when last change made it, , not match last time ran job. also, log files in /user/hduser/output_dir not match $hadoop_home/logs/userlogs known problem, , there solution this? did not find answer anywhere. help.!

edit - found out log files being written after intervals of time, if job run twice within time new log files aren't written that. why so, , how can override using configuration changes, if it's possible?


Comments

Popular posts from this blog

php - Calling a template part from a post -

Firefox SVG shape not printing when it has stroke -

How to mention the localhost in android -