AI Engineer Jobs in New York, USA

Looking for an AI engineer job in New York? Choose from 96 open roles at 32 employers. Explore real salary data and skills breakdown across remote, hybrid and on-site roles.

96 Open roles
32 Companies hiring
247K Average salary

What do AI engineers in New York work on?

The roles on this page centre on building, deploying, and operating large language model systems in production. Much of the work involves LLM inference optimisation, fine-tuning, and evaluation pipelines, as seen across Capital One's postings for positions such as Lead AI Engineer (LLM Customization, Finetuning, Reinforcement Learning) and Senior Lead AI Engineer (Gen AI Platform Services). Agentic architectures appear frequently, including multi-agent orchestration and guardrail systems. The AI / Agent Engineer role at Appnovation Technologies focuses on MCP servers and graph-RAG pipelines connected to enterprise documents. A handful of postings include people-management responsibilities, as in the Senior Manager, AI Engineer position overseeing infrastructure teams. Vision-language model customisation and foundation model training also feature among the sample titles, suggesting some roles sit closer to research-adjacent engineering than to pure application development.

Skills and experience employers ask for

These counts reflect mentions in posting descriptions across the full set of postings on this page, not formal requirements. Python and LLM-related skills appear in the large majority of postings. All three major cloud platforms appear at roughly similar frequency. Java, C++, and PyTorch are each mentioned in roughly half the postings. A notable share of postings mention a master's degree and publications, suggesting some roles value research background, though the small total sample limits how far these patterns can be generalised.

LLMs 89%
Python 82%
Evaluation 80%
AWS 55%
Azure 55%
Agents 54%
GCP 51%
Java 49%
A/B testing 49%
PyTorch 47%
Master's degree 47%
C\+\+ 42%
Publications 42%
APIs 35%

AI Engineer roles that state a salary

The employers' own advertised ranges, for individual roles at different levels โ€” not an average and not a market rate.

New York office, hybrid or remote?

A clear majority of postings on this page are listed as onsite, making fully in-office the dominant stated arrangement. A smaller portion are hybrid, and only a very small number are listed as fully remote. No postings have an unknown work mode, so the picture is relatively complete, though the specific hybrid schedules โ€” days per week, flexibility โ€” are not detailed in these postings. Candidates interested in hybrid or remote options will find noticeably fewer roles to consider here than those open to onsite work.

Make your application specific to the work

  1. Check degree and experience requirements Several postings, particularly from Capital One, state explicit combinations of degree level and years of AI/ML experience. Review these before applying, as the stated thresholds vary by seniority level.
  2. Prepare examples of LLM work Given how widely LLM systems, evaluation, and agents appear across these postings, be ready to describe specific projects involving model deployment, fine-tuning, or pipeline design in concrete terms.
  3. Note the work-mode expectation early Most postings require onsite presence in New York City; confirm the arrangement for each role before investing time in an application, as hybrid and remote options are limited in this set.
  4. Clarify pay where not advertised Only a minority of postings include advertised salary ranges; for those that do not, you may need to ask directly during the process or use the published ranges from similar roles on this page as a reference point for your own conversations.

Questions about AI Engineer jobs in New York

A master's degree is mentioned in a large share of the postings, but several also state a bachelor's degree plus additional years of experience as an alternative path. The specific combination required varies by role and employer, so check each posting individually.

Only a handful of postings on this page include advertised ranges. The published figures span from around $142,800 at the lower end to $352,000 at the top, but these come from a small number of specific roles at specific employers and should not be read as representative of all roles listed here.

Remote is stated for a very small number of postings on this page. The majority are listed as onsite, with a smaller portion hybrid. Candidates seeking fully remote work will find very limited options in this set.

Capital One accounts for the largest share of postings, followed by Anthropic. OpenAI, Datadog, Ramp, Reflection AI, Turing, and Braze each have at least two postings. Other employers are also represented but with fewer listings.

Agents and agentic AI are mentioned in roughly half the postings on this page, making it a common but not universal theme. Roles focused on agentic infrastructure or guardrails mention it explicitly, while others centre more on LLM inference, fine-tuning, or evaluation.

Jobs checked 36 minutes ago. ยท Guide reviewed 14 September 2026.