Introduction In recent years, the development of big data is in full swing. Many people choose to study big data or switch to big data, which contains a lot of work. So when making a job choice, you still need to make a reasonable choice. In order to help you better enter the big data industry, here is a detailed introduction to the interview content of 202 1 big data engineer.

1, introduce yourself

Generally speaking, it is to introduce yourself and talk about your work experience and project experience. The interviewer will give you a technical interview based on your project experience. When introducing yourself, you must grasp the core, don't be too wordy, try to amplify your own value, and let the interviewer feel your enthusiasm for work and your ability to contribute to the company in the future.

2, several kinds of warehouse development knowledge and skills

(1)Java is necessary, but it is not deep enough, which is enough for the interview of Java.

(2)Hadoop ecology, Yarn, Zookeeper, HDFS, these underlying principles should be understood, and interviews are often asked.

(3) The shuffling process of 3)Mapreduce is also a question that is often asked in the interview.

(4)Hbase and HIve, it really doesn't make sense to engage in big data.

(5)Mysql, Oracle and Postgres database operations should be returned, and sql should be able to write.

(6)linux operating system, this simple command must be understood, and it is best to write a shell script.

(7) At least one data processing tool, such as 7)Kettle or Sqoop. 8. Data warehouse modeling and data model problems.

3. Technical knowledge and skills

(1)SparkSql and SparkStreaming, underlying principle, kernel, task submission process, etc. , as far as possible in-depth insider, often compared with MapReduce. Of course, you should also know about storms and flink. Flink is a suggestion that you should learn and will be more and more useful in the future.

(2)Redis, Kafka and ElasticSearch all have to understand the principle, deeply understand, use, operate and tune.

(3) Impala and Kirin should try to understand and use them.

(4)Python, if I have the ability and energy, I suggest studying in depth. I am currently teaching myself.

(5) The cluster problem includes some simple operation and maintenance knowledge.

(6) The problem of big data data tilt, including the memory tuning of Spark JVM and so on.

So much for the interview content of 202 1 Big Data Engineer. I hope I can help you. Of course, entering the big data industry requires you to constantly improve your skills in order to have a better place.