Add finetuning samples and tests #36888
Open
+3,528
−106
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
### Packages impacted by this PR ### Issues associated with this PR ### Describe the problem that is addressed by this PR ### What are the possible designs available to address the problem? If there are more than one possible design, why was the one in this PR chosen? ### Are there test cases added in this PR? _(If not, why?)_ ### Provide a list of related PRs _(if any)_ ### Command used to generate this PR:**_(Applicable only to SDK release request PRs)_ ### Checklists - [ ] Added impacted package name to the issue description - [ ] Does this PR needs any fixes in the SDK Generator?** _(If so, create an Issue in the [Autorest/typescript](https://github.com/Azure/autorest.typescript) repository and link it here)_ - [ ] Added a changelog (if necessary)
mohammadsheraj
requested review from
a team,
bobogogo1990,
dargilco,
ganeshyb,
glharper and
jeremymeng
as code owners
Contributor
There was a problem hiding this comment.
Pull request overview
This PR adds comprehensive finetuning samples and tests for the Azure AI Projects SDK, demonstrating three fine-tuning methods: Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Reinforcement Fine-Tuning (RFT). The changes include test files, sample code for both TypeScript and JavaScript, training/validation datasets, and updated documentation.
Key Changes:
- Added test infrastructure with helper utilities and comprehensive test suite covering all three fine-tuning methods
- Implemented sample code demonstrating job creation, deployment, and inference workflows
- Included training and validation datasets in JSONL format for all fine-tuning types
- Updated package dependencies to include Azure Cognitive Services Management Client
Reviewed changes
Copilot reviewed 39 out of 44 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| sdk/ai/ai-projects/test/public/node/finetuning/finetuningHelper.ts | Helper constants and enums for fine-tuning job types, training types, and test parameters |
| sdk/ai/ai-projects/test/public/node/finetuning/finetuning.spec.ts | Comprehensive test suite covering create, retrieve, list, cancel, pause, resume, events, checkpoints, deploy, and infer operations |
| sdk/ai/ai-projects/test/public/node/finetuning/data/*.jsonl | Training and validation datasets for SFT, DPO, and RFT methods |
| sdk/ai/ai-projects/samples/v2-beta/typescript/src/finetuning/*.ts | TypeScript samples for supervised, DPO, reinforcement, and OSS model fine-tuning |
| sdk/ai/ai-projects/samples/v2-beta/javascript/finetuning/*.js | JavaScript equivalents of TypeScript samples |
| sdk/ai/ai-projects/samples/v2-beta/*/package.json | Added @azure/arm-cognitiveservices dependency for model deployment |
| sdk/ai/ai-projects/samples/v2-beta/typescript/README.md | Updated documentation with links to new finetuning samples |
Files not reviewed (1)
- pnpm-lock.yaml: Language not supported
mohammadsheraj
requested review from
benbp,
mikeharder and
weshaggard
as code owners
mohammadsheraj
changed the title
mohammadsheraj
changed the title
Contributor
Author
|
JS SDK Finetuning samples and tests are complete and tested to work. |
sdk/ai/ai-projects/samples-dev/finetuning/sample_finetuning_oss_models_supervised_job.ts
Show resolved
Hide resolved
sdk/ai/ai-projects/samples-dev/finetuning/sample_finetuning_oss_models_supervised_job.ts
Show resolved
Hide resolved
sdk/ai/ai-projects/samples-dev/finetuning/sample_finetuning_reinforcement_job.ts
Show resolved
Hide resolved
sdk/ai/ai-projects/samples-dev/finetuning/sample_finetuning_supervised_job.ts
Show resolved
Hide resolved
bobogogo1990
approved these changes
Dec 19, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Packages impacted by this PR
Issues associated with this PR
Describe the problem that is addressed by this PR
What are the possible designs available to address the problem? If there are more than one possible design, why was the one in this PR chosen?
Are there test cases added in this PR? (If not, why?)
Provide a list of related PRs (if any)
Command used to generate this PR:**(Applicable only to SDK release request PRs)
Checklists
Autorest/typescript repository and link it here)
Packages impacted by this PR
Issues associated with this PR
Describe the problem that is addressed by this PR
What are the possible designs available to address the problem? If there are more than one possible design, why was the one in this PR chosen?
Are there test cases added in this PR? (If not, why?)
Provide a list of related PRs (if any)
Command used to generate this PR:**(Applicable only to SDK release request PRs)
Checklists