Candidate Profile — Candidate #5
Position: Adobe — Machine Learning Infrastructure Engineer (San Jose, CA; San Francisco, CA; Seattle, WA)
Candidate Location: San Francisco Bay Area
Relevant Experience & Education Highlights
Expertise in optimizing large-scale generative AI models with transformers, diffusion models, and advanced inference techniques like FSDP and vLLM positions this candidate to excel in building scalable ML infrastructures for Adobe's Firefly generative AI initiatives.
1. Build and optimize infrastructures that power large foundation model training on thousands of GPUs
Proven track record in scaling AI training and inference systems with GPU-optimized techniques.
- Optimized large-scale Transformer and Diffusion models integrating FlashAttention, FSDP (Fully Sharded Data Parallel), vLLM, and speculative decoding for efficient inference and deployment.
- Led development of Retrieval Models leveraging Retrieval-Augmented Generation (RAG), Dense Retrieval (DR), Vector DBs including FAISS, Weaviate, Pinecone, and Hybrid Search (BM25, Neural).
- Developed self-improving AI architectures using continual learning, active learning, and adaptive fine-tuning pipelines.
- Advanced Knowledge Graph-based AI Reasoning by integrating structured data with transformer-based models.
2. Architect and optimize end-to-end ML pipelines, ensuring they're scalable, efficient, and robust
Hands-on experience architecting production-grade ML systems with MLOps tools and cloud services.
- Developed Generative Media solutions enhancing Text-to-Image (Stable Diffusion, DALL-E, Midjourney), Video Generation (Runway Gen-2, Sora), and Audio Generation (MusicLM, AudioCraft).
- Spearheaded architectures leveraging Mixture-of-Experts (MoE), Task-Specific Adapters, and Transformer-based models for scaling AI across domains.
- Utilized Apache Airflow, Apache Kafka, Amazon S3, Amazon Kinesis, and Amazon Redshift for data processing pipelines at a major enterprise.
- Deployed scalable systems with AWS services including Amazon EC2.
3. Dive deep into data to recommend the right models, evaluation metrics, and governance approaches
Deep domain knowledge in generative AI aligns with selecting optimal models for creative applications.
- Published and patented novel methodologies in memory-augmented reasoning, multimodal retrieval, and generative AI.
- Defined AI product roadmaps aligning state-of-the-art research with enterprise solutions for intelligent assistants and LLM-driven applications.
- Collaborated cross-functionally with leading research teams to integrate advanced AI memory reasoning, multimodal models, and retrieval-enhanced architectures into production.
- Drove innovation in recommendation and personalization systems using Deep Learning and Large Language Models (LLMs) at a luxury retail company.
Requirements & Candidate Alignment
| Adobe Requirement | Candidate Qualification |
|---|---|
| Graduate, PhD, or postgraduate degree in Computer Science, Computer Engineering, or a related field—or equivalent experience. | Equivalent experience through AI fellowship and leadership roles in generative AI research and development. |
| 2+ Years ML Engineering experience, specializing in generative AI like LLMs. | Extensive ML Engineering experience specializing in generative AI including LLMs, transformers, and diffusion models across multiple leadership roles. |
| Strong Python and deep learning engineering skills, paired with experience in training and inferencing with PyTorch or TensorFlow. | Strong Python and deep learning engineering skills with PyTorch, DeepSpeed, and TensorFlow for training and inference. |
| Familiarity with distillation, transformers, and diffusion models. Experience with generative image and video is a plus. | Deep familiarity with transformers, diffusion models including Stable Diffusion, and generative image/video solutions like DALL-E, Midjourney, Runway Gen-2, and Sora. |
| Knowledge of deployment technologies such as Docker, ML Ops, and ML services. | MLOps proficiency with Apache Airflow, Apache Kafka, Kubernetes, Jenkins, GitHub Actions, Vertex AI, and ML services. |
| Experience with cloud platforms like Azure and AWS is a plus. | Hands-on AWS experience including Amazon EC2, Amazon S3, Amazon Kinesis, Amazon Redshift, Azure, Google Cloud, and Amazon Web Services. |
| Excellent problem-solving abilities and capacity to analyze complex issues and drive solutions with a data-driven approach. | Data-driven problem-solving demonstrated through optimization of large-scale models and AI product roadmaps. |
| Strong verbal and written communication skills and success in cross-functional team environments. | Proven cross-functional collaboration with research teams and partners on production AI integrations. |
If you would like to discuss this candidate or other critical roles, here is a link to my calendar to schedule a call:
Schedule a CallContact:
Finding the signal in the noise since 2005