The big data software engineer will be responsible for planning design and core code development of the big data platform. The engineer is responsible for the mass data collection, processing and storage, technical selection and arch implementation of application schema. Be responsible for building data pipelines or tools to pull information from different sources. Build distributed storage , streaming/real-time computing and other application layer. Responsible for theme construction, data center and application layer design and development in the planning business. Responsible for data governance, data usability and data quality, and ensure the accuracy, timeliness and stability of data. Deep into the business, understand and reasonably abstract the business needs, give full play to the data value, and work closely with the business team.

Key tasks and responsibilities

• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)

• Participate in the data modeling , especially spatial modeling

• Responsible for data center platform setup, log transfer and modeling

• Participated in the construction, maintenance and optimization of data platform based on real-time technology, and provided easy-to-use data tools and platforms for businesses

• Pay attention to the development of open source technology

• Support massive data analysis, data mining and machine learning through big data platforms and tools, and improve online product effect and offline operation efficiency

Qualification and skills

1.1 Education background

1.2Working experiences

• 5+ years’ experience on big data platform development and architecture.

1.3Technical / Professional skills

• Rich experience in Java development, proficient in Java and Spring etc, optimize JVM performance.

• Strong programming experience in Python (Pandas, Numpy, Notebooks)

• Familiar with Mysql Redis and MongoDB etc, network programming and concurrency technology, and security solutions.

• Rich experience in the design and implementation of back-end service system and independent system-level design ability.

• Solid computer foundation, familiar with common data structures and algorithms, and familiar with Linux system environment.

• Familiar with big data technology stack, experience in using and optimizing Hadoop, Hive, Spark,Flink,Oozie Hbase, Kafka, ELK and other big data open source components is preferred.

• Knowledge and experience in data modeling (machine learning, data mining, information retrieval) and analytical theory.

• Have certain algorithm ability and know some common algorithm tools, including but not limited to: k-means clustering, LDA. Neural network, Euclidean distance, SVM. Over/under fitting, DL

• Internet of vehicles experience is preferred.

1.4 Leadership skills

• Drive for results

• Excellent
  interpersonal and communication skill

Volkswagen Group China

Volkswagen Group is one of the earliest and most successful international partners of China’s automobile industry. The Group has grown together with China’s auto industry, overcoming many challenges and achieving significant growths, during the 30 years’ partnership with China.

As early as 1978, Volkswagen Group started contacts with China. The first Santana was produced in Shanghai in April 1983. In October 1984, Shanghai Volkswagen Corporation Ltd, the first joint venture of Volkswagen Group in China, laid foundation in Shanghai. In February 1991, FAW-Volkswagen Corporation Ltd was established in Changchun, creating Volkswagen Group’s second joint venture in China.

The business scope of Volkswagen Group in China includes the production, sales and services of complete vehicles and parts, such as engines and transmissions. All of the Group auto brands — including Volkswagen, Audi, SKODA, SEAT, Bentley, Bugatti, Lamborghini, Porsche, Ducati, Volkswagen Commercial Vehicles, Scania and MAN — have a business presence in China through Volkswagen Group China and its subsidiaries.