Add JIT regression test extraction skill#123795
Conversation
…ssues Co-authored-by: EgorBo <523221+EgorBo@users.noreply.github.com>
|
@dotnet/jit-contrib @jakobbotsch @stephentoub The convention for these tests may not be trivial for copilot to figure out itself sometimes. With this skill (I presume it's better than leaving that in copilot-instruction.md because we don't want to pollute its general context with something it doesn't need most of the time) it can extract a repro test from a github issue with just prompt. Useful for bugs reported by Fuzzlyn, can be used by CCA or locally. We probably will rewrite the existing prompt-files to skills as well since Skills are an open standard all agentic editors/tools support, while prompt files were VSCode only. |
There was a problem hiding this comment.
Pull request overview
This PR adds a new Copilot skill for extracting JIT regression test cases from GitHub issues into the standardized src/tests/JIT/Regression/JitBlue/Runtime_<issue_number>/ structure.
Changes:
- New skill documentation providing step-by-step guidance for creating JIT regression tests
- Code examples based on real tests (Runtime_99391, Runtime_97625, Runtime_95315)
- Instructions for when to create custom .csproj files (environment variables, unsafe code)
- Common patterns for test structure and environment variable configuration
|
Ping, cc @jakobbotsch |
|
/ba-g "Helix Queue Insights (preview)" and "Build Analysis" stuck |
Description
Adds a new Copilot skill that guides extraction of standalone JIT regression test cases from GitHub issues into
src/tests/JIT/Regression/JitBlue/Runtime_<issue_number>/.Skill contents
Runtime_*tests (license header, file-scoped namespaces,[Fact]attribute usage).csprojfile (environment variables, unsafe code, special settings)CLRTestEnvironmentVariablepatterns (DOTNET_TieredCompilation,DOTNET_TieredPGO, etc.)Runtime_99391,Runtime_97625,Runtime_95315Structure
Follows the same format as the existing
performance-benchmarkskill.Original prompt
✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.