1. Responsible for massive data processing, data calculation and data development based on Hadoop and Spark platforms;
2. Responsible for the development of online data systems with high concurrency, high availability and high scalability;
3. Responsible for data mining application service development and data mining algorithm research and application;
4. Responsible for related development support of data products and data projects;
5. Responsible for data exploration in vertical fields and value data extraction.
1. Bachelor degree or above in computer science, more than 3 years working experience;
2. Proficient in java and scala development technology, proficient in multi-process / multi-thread development, familiar with common design patterns;
3. Familiar with big data development technologies such as ElasticSearch, Hadoop, Spark, Sqoop, Kafka, HBase, Impala, Kudu, etc;
4. Have enthusiasm for the development of IT technology, have a spirit of technological innovation, and have the courage to solve technical problems;
5. Machine learning, data mining, recommendation system experience is preferred;
6. Background development experience such as distributed computing / search engine is preferred.