Distributed System Engineer - Apache Spark (NCG)
英伟达半导体科技(上海)有限公司
- 公司性质:外资(欧美)
- 公司行业:电子技术/半导体/集成电路
职位信息
- 发布日期:2021-01-04
- 工作地点:上海
- 招聘人数:若干人
- 工作经验:本科
- 学历要求:招若干人
- 语言要求:不限
- 职位类别:大学/大专应届毕业生
职位描述
NVIDIA is seeking Software Engineers to accelerate Apache Spark and related frameworks for data science.
Data scientists spend a considerable amount of time exploring data, iterating over machine learning (ML) experiments. Every hour of compute required to sort through datasets, extract features, fit ML algorithms, hinders the ability of data scientists to drive towards results. Apache Spark is the most popular data processing engine in data centers for data science. It is used for interactive data science, from data preparation, to running ML experiments, and all the way to deployment of ML applications.
You will work with open source community to accelerate Apache Spark with GPU for data science. Nvidia believes that data science workflows can benefit tremendously from being accelerated, to enable data scientists to explore many more and larger datasets to drive towards their business goals, faster, and more reliably.
What you'll be doing:
1. Creating a collection of GPU accelerated libraries for ML and data analytics
2. Designing and implementing distributed algorithms in Apache Spark
3. Collaborating with open source communities, including Apache Spark and RAPIDS
4. Working with Nvidia strategic partners on deploying advanced machine learning and data analytics solutions in public cloud or on-premise clusters
5. Presenting technical solutions in industry conferences and meetups
What we need to see:
1. BS, MS, or PhD in Computer Science, Computer Engineering, or closely related field
2. Excellent programming skills in C++, Java, Scala and/or Python
3. Strong technical skills in designing and implementing distributed solutions
4. Working experience with key open source big-data projects including Apache Spark, Apache Hadoop, Apache Flink, and Apache Kafka
5. Able to work successfully with multi-functional teams across organizational boundaries and geographies
6. Highly motivated with strong communication skills
Ways to stand out from the crowd:
1. Prior contribution at major open source distributed system projects would be a hug plus
2. Working experience with GPU-accelerated libraries (CUDA, NCCL, RAPIDS) is highly desired
3. Basic ML/DL training and/or experience with Spark ML and XGBoost would be valuable
We are an AA/EEO/Disabled employer and with highly competitive salaries and a comprehensive benefits package, NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most brilliant and talented people on the planet working for us. Are you creative and autonomous? Do you love a challenge? If so, we want to hear from you.
职能类别:大学/大专应届毕业生
公司介绍
我们定义了现代计算机图形
我们拥有世界第 一大游戏平台GEFORCE
我们助力世界上运行速度最快的超级计算机
1999年,从行业第 一个图形处理单元(GPU)GeForce 256开始,我们始终深耕技术,寻求创新和突破。最新的NVIDIA A100 GPU更是搭载全球***的7纳米处理器NVIDIA Ampere GPU架构问世,实现了迄今为止***的GPU性能飞跃。
这是每一位NVIDIA工程师的匠人之心。
我们从图形计算起航,拥抱AI和加速计算的浪潮,为当代达·芬奇和爱因斯坦打造专属计算机,帮助他们看见并创造未来。
这是NVIDIA工程师团队开辟的创新之路。
我们看到超级计算的适用范围正在迅速扩展,未来全球信息经济的重心将从服务器转移到新型的强大且灵活的数据中心。以数据中心为计算单元的新时代已经来临。
我们感知到身边越来越多的事物可以是智能的、云连接的,并且基于一个可以为几乎每个行业构建富有想象力的服务的平台。万物智能的变革已经开始。
我们已经开始加速从芯片到CPU和GPU的连接方式,更希望与你一起将其推及至整个软件堆栈,最终实现跨数据中心的性能提升。
加入我们!让我们一起推动高性能计算的下一个时代,让我们在关乎世界却只有我们能把握的棘手新机遇中并肩前行!