@arunisaac just don't pay attention. If they ask directly, explain that how you use your machine in linux is a choice of the user, it's as easy as installing a program, and it's not imposed by the system; if you want to, you can use a graphical system, but you feel more comfortable using commands.
Most people understand it after explaining those points.