Skip to content

feat: add apex/agent testing capabilities to MCP @W-18609330@ #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 23, 2025

Conversation

WillieRuemmele
Copy link
Contributor

What does this PR do?

adds agent/apex testing to MCP
image
image

What issues does this PR fix or reference?

@W-18609330@

agentApiName: z.string().describe(
`Agent test to run
if unsure, list all files matching the pattern *.aiEvaluationDefinition-meta.xml
only run test can be run at a time
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

only one test

@mdonnalley
Copy link
Contributor

QA:
These are prompts that I ran. 🟢 means that the LLM behaved expectedly

🟢 Run test WeatherService in the org

  • I didn't deploy this test first and it was really cool to see the agent figure that out and ask me if I wanted to deploy it

🟢 Run Local_Info_Agent_Test
🟢 Run this test
🔴 Run all tests in org
This consistently gave my RunLocalTests
Input:

{
  "classNames": [],
  "usernameOrAlias": "[email protected]",
  "testLevel": "RunLocalTests",
  "directory": "/Users/mdonnalley/repos/VivekMChawla/afdx-test"
}

This should have picked RunAllTestsInOrg

🟢 run all my tests using RunAllTestsInOrg test level
🟢 run lightning tests
🟢 run agent tests

@mdonnalley
Copy link
Contributor

mdonnalley commented Jun 20, 2025

I just thought this would be an interesting experiment. QA using #60

That last prompt probably isn't a great indication of how well the tool is written. In the real world, IDEs will have loaded enough context that the LLM would have made smarter decisions

Screenshot 2025-06-20 at 3 16 51 PM

@mdonnalley mdonnalley merged commit c26e8fe into main Jun 23, 2025
9 checks passed
@mdonnalley mdonnalley deleted the wr/addTestingTools branch June 23, 2025 16:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants