Commit Graph

154 Commits

Author SHA1 Message Date
Rich Lander 1090705a38
Add doc on OS onboarding (#112026)
* Add doc on OS onboarding

* Update docs/project/os-onboarding.md

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

* Update docs/project/os-onboarding.md

* Apply suggestions from code review

Co-authored-by: Jan Kotas <jkotas@microsoft.com>

* Expand scope of doc per feedback

* Update raw links

* Apply suggestions from code review

Co-authored-by: Jan Kotas <jkotas@microsoft.com>

* Adding "Environments" as a new section

* Update Xcode casing

* Update docs/design/datacontracts/Exception.md

* Improve intro

* Fix typo

* Update docs/project/os-onboarding.md

Co-authored-by: Jan Kotas <jkotas@microsoft.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jan Kotas <jkotas@microsoft.com>
2025-02-10 14:57:00 -08:00
Ivan Diaz Sanchez 2b679cf050
Fix Workflow Broken Markdown Links (#110332)
* Fix Markdown links that broke after the workflow documentation reconsolidation.

* Fixed two other links that broke outside the workflow documents.

* Changed 'Debian/Ubuntu' to 'Debian and Ubuntu' in the Linux requirements doc because otherwise, I couldn't get the table of contents link to work correctly.
2024-12-03 10:20:36 -08:00
Jeremi Kurdek 4900696761
[mono] Updated runtime test building doc (#108792) 2024-10-12 09:09:24 +02:00
Viktor Hofer c4b3d81df1
Target .NET 10 / net10.0 (#106599)
* Update dotnet10 feeds

* Update hardcoded old TFM values

* More hardcode updates and TFM checks

* Updates and delete duplicate file in Bcl.Numerics

* Linker stays on net9.0

* Fix .NET SDK max supported version

* Update apicompat sfx apicompat baseline file

* Update Microsoft.NET.WebAssembly.Threading APICompat settings

* Fix DiagnosticSource build

* Update SDK to RC1 for needed GetAlternateLookup API

to be able to build System.Text.Json on net9.0.

* Fix APICompat runtime regex pattern

* Suppress Bcl.Memory compatibility error for dropped framework

* Fix BinaryFormatter tests regex pattern for version subsitution

* Update BinaryFormatterTests.cs

* Pin SdkVersionForWorkloadTesting to the version in global.json

* Treat net9 and net10 as current for now

* Bump MicrosoftDotNetILCompilerVersion

* Update BinaryFormatterTests.cs

* Update System.Resources.Extensions

* Update AutoImports as well

* Fix ImporterTests.cs

* Block failing SignalRClientTests

* Update XmlSerialzation Schema Import tests.

* Update Versions.props

* Update CompatibilitySuppressions.xml for System.Numerics.Tensors

* Don't set EnableDefaultCompileItems, it doesn't work since we set EnableDefaultItems=false higher up

* Update regex in legacy BinaryFormatterTests.cs too

* Hardcode BinaryFormatter test assembly version to 9.0

This allows us to not change the majority of the tests

* Fix typo

* Fix issue in Microsoft.NET.Workload.Mono.Toolchain.Current.Manifest.pkgproj

* Replace ForceNet8Current in a few more places

* Fix wasi workload

* Fix TreatAsCurrent for 10.0

* Add net9 workload manifests

* Update PackageId in icrosoft.NET.Runtime.WebAssembly.Templates.csproj

* Update ApiCompatBaseline.NetCoreAppLatestStable.xml

Changes from https://github.com/dotnet/runtime/pull/107758

* Remove duplicate dotnet10 feeds from nuget.config

* Update Versions.props

* Fake SDK band version for now

* Update Versions.props

* Update the SDK band versions for real

* Update the dotnet/sdk dependencies

* Update emsdk to net10 workloads

* Install a 9.0 runtime for workload tests too

* Update the compat tasks

* Merge in changes from net10-manifests

* Tmp: Trying out @am11's branch.

* Tmp2: Trying out @am11's branch.

* Tmp3: Replace the last usage of main in clone action.

* Update eng/pipelines/coreclr/templates/build-perf-bdn-app.yml

Co-authored-by: Adeel Mujahid <3840695+am11@users.noreply.github.com>

* Update eng/pipelines/coreclr/templates/perf-job.yml

Co-authored-by: Adeel Mujahid <3840695+am11@users.noreply.github.com>

* Update eng/pipelines/runtime-wasm-perf.yml

Co-authored-by: Adeel Mujahid <3840695+am11@users.noreply.github.com>

---------

Co-authored-by: Larry Ewing <lewing@microsoft.com>
Co-authored-by: Jackson Schuster <36744439+jtschuster@users.noreply.github.com>
Co-authored-by: Alexander Köplinger <alex.koeplinger@outlook.com>
Co-authored-by: Ilona Tomkowicz <itomkowicz@microsoft.com>
Co-authored-by: Steve Molloy <smolloy@microsoft.com>
Co-authored-by: Adeel Mujahid <3840695+am11@users.noreply.github.com>
2024-09-25 11:28:31 -05:00
Ivan Diaz Sanchez 4df87aeb12
Document Important Note About the Host and the CLR for Testing (#108162) 2024-09-23 14:45:46 -07:00
Jeremy Koritzinsky d2c19db316
More Test System documentation (#106899) 2024-08-23 13:27:36 -07:00
Jan Kotas 58b5a6c229
A few more net8 to net9 renames (#104342) 2024-07-03 10:27:01 -07:00
Jan Kotas 99e94ce55d
Replace net8 with net9 under docs (#104189)
Fixes #104088
2024-06-29 07:44:01 -04:00
Alexander Köplinger 7107ff64f3
Update references to dotnet/installer repo (#103077)
The installer repo was merged into the sdk repo.
2024-06-06 00:11:49 +02:00
Ken Dale 59f2833b98
Update docs.microsoft.com usages to learn.microsoft.com (#102881)
* Update https://docs.microsoft.com to https://learn.microsoft.com

* Update http://docs.microsoft.com/ to https://learn.microsoft.com (removes trailing slash)

* Update docs.microsoft.com to https://learn.microsoft.com

* Update docs.microsoft.com to learn.microsoft.com

* Replace learn.microsoft.com/en-us/ with learn.microsoft.com/ to remove locale from urls
2024-05-31 11:27:45 -07:00
Jeremy Koritzinsky 4760cf03a6
Introduce a `BuildAllTestsAsStandalone` environment variable to support some local dev scenarios. (#100709) 2024-04-18 14:38:42 -07:00
Aleksey Kliger (λgeek) 756f869c3a
[docs] Document tools tests workflow (#101186)
* [docs] Document tools tests workflow
2024-04-17 12:57:59 -04:00
Elinor Fung 960849bc11
Make host tests use single copy of shared framework (#100588)
- Only create one .NET install layout to be shared by all host tests
-  Add `pretest.proj` for `host.pretest` subset that builds all test project assets and creates the single .NET install layout
- Fix `NativeHostApis` tests that were editing the .NET install layout directly (instead of creating a copy to edit)
  - Remove some unnecessary copying/creating of SDKs and frameworks by sharing the fixture across tests
- Update host testing doc with simpler setup instructions and more details around investigating test failures
2024-04-04 15:08:13 -07:00
Elinor Fung 316fc16153
Remove requirement for building packs to run host tests and infrastructure around restoring test project assets (#100324)
- Delete build infrastructure around test project asset restore
- Remove requirement that packs must be built before running host tests
  - Building packs was only necessary to support directing the restore/build for the test project assets to the built packs
2024-03-29 12:25:24 -07:00
Elinor Fung d4c6e95db5
Update doc on using local apphost to reflect that the testhost layout uses the live-built host (#100314) 2024-03-26 19:21:18 -07:00
Vitek Karas 578e82967c
Allow using VS to run host tests when libraries use different config (#91873)
* Allow using VS to run host tests when libraries use different config

When building the host tests from VS, there are dependencies on projects from the libraries subset. If the libraries are prebuilt with different configuration (typically `Release`) the build in VS breaks because it can't find the project's output.

This change modifies the import of generators (which are the problematic projects) to let them override the configuration of the referenced projects.

It then adds the ability to set environment based on the `-lc` parameter to the build script when starting VS.

Also updates the doc to describe how to use this.

* Update eng/build.ps1

Co-authored-by: Elinor Fung <elfung@microsoft.com>

* Update eng/generators.targets

* Move ShouldUnsetParentConfigurationAndPlatform to repo's Directory.Build.props

---------

Co-authored-by: Elinor Fung <elfung@microsoft.com>
2024-03-13 12:48:33 +01:00
Grégoire fa94b88777
Add note about docker in the testing doc (fix #95436) (#95557)
* Add note about docker in the testing doc (fix #95436)

* Update testing.md
2024-01-19 12:16:51 +01:00
Matous Kozak 9989c9a7af
[mono][docs] Add BuildAsStandalone export to mono runtime tests doc (#96054) 2023-12-15 16:24:25 +01:00
Dan Moseley fc83305389
Update testing.md (#88364) 2023-07-06 19:34:21 -05:00
Dan Moseley 8d0b619038
Disable StressTestDeepNestingOfLoops for NonBacktracking engine (#87369)
* Disable hanging RE test

* feedback

* Oops

* Apply suggestions from code review

Co-authored-by: Stephen Toub <stoub@microsoft.com>

* Update testing.md

---------

Co-authored-by: Stephen Toub <stoub@microsoft.com>
2023-06-12 22:05:13 -04:00
Milos Kotlar d8cf33b287
Add instructions for running the runtime tests on iOS platforms (#86045) 2023-05-10 17:21:43 +02:00
Will Smith 4719575531
Skip methods in test-merging if they use the named argument 'Skip' for the Fact attributes (#85495)
* Skip methods in test-merging if they use the named argument 'Skip'

* Use ActiveIssueAttribute instead of FactAttribute with Skip. Add documentation about FactAttribute and Skip.
2023-04-28 12:22:08 -07:00
Adeel Mujahid 3b63eb1346
Replace remaining instances of COMPlus with DOTNET (#82985)
* Replace remaining instances of COMPlus with DOTNET

* Fix heading in RyuJIT tutorial
2023-03-05 08:40:20 -08:00
Ivan Diaz Sanchez bf0608f48f
[Continuation] - Enable the fundamentals behind libraries tests compiled via Crossgen2 (#80946)
* Added the documentation regarding the new libraries test modes.

* Enable the fundamentals behind libraries tests compiled via crossgen2.

* Fixed a typo with SINGLE_FILE_TEST_RUNNER.

* Addressed review comments.

* Restored an accidentally deleted comment.

* Fixed wrong Crossgen2 path and added comment with link to an important tracking SDK bug.
2023-02-20 15:07:30 -08:00
Thays Grazia 9fcbeee2e4
The path of androd_sdk was changed. (#82256) 2023-02-17 12:19:35 -03:00
Jeff Handley 1166bba6d1
Refine corerun instructions. Improve argument parsing in src/tests/build. (#81733)
* Refine corerun instructions. Improve arg parsing in src/tests/build.

* Revert the libraries configuration default. Refine usage and docs.

* Exit argument processing at first unrecognized arg per existing pipeline usage
2023-02-08 13:41:21 -08:00
Ilona Tomkowicz f8ab555409
[wasm][debugger][libs] Documentation: How to debug library tests (#77368)
* Draft.

* DevTools as IDE instructions.

* VS Code as IDE instructions.

* Correction: `WebRoot` is not required.

* Added: expect long wait & new pic without webRoot

* Renamed as suggested by @pavelsavara.

* The first bp is not automatic, user has to set it on their own.
2023-01-31 14:54:46 +01:00
Šimon Rozsíval 828edfb2e4
[Android] Bump target SDK version in Android manifest (#80923)
* Set target SDK version

* Update Android docs

* Disable tests that do not pass with target API 31

* Check if the installed Android SDK is up-to-date

* Update skip explanation

* Use latest SDK

* Disable failing System.Net.Security test
2023-01-24 19:51:17 +01:00
Viktor Hofer 2ca7cf7140
Lowercase TargetOS (#80164)
Follow-up on #32451
Follow-up on #80074

In #43651, the "Windows" OS name was lowercased to achieve target frameworks with RIDs in them. At that time, the original plan was to lowercase all TargetOS values but that had to be cut because of resources. This PR finishes that and updates build systems, YML, markdowns and managed components.

To not break existing developer workflows, the passed-in -os value is automatically lower-cased in the script entry points and validated in the msbuild entry point.
2023-01-11 17:58:32 +01:00
Viktor Hofer 46780fd365 Update 'net7.0' usages in the repo 2022-11-18 21:24:56 +01:00
David Wrighton 939f050e32
Improve coreclr test infra (#77929)
These fixes were built for PR #74886; however, as that PR is so utterly large and unreviewable, I've pulled out the test infra changes for separate review

Changes
- Increase the number of trampolines in the llvm aot compilation process to 20,000 from 10,000 (This avoids running out of them in some of the hardware intrinsics tests
- Add a concept of striping tests when running under GC stress
  - To use this new feature, specify <NumberOfStripesToUseInStress>N</NumberOfStripesToUseInStress> within the merged test assembly. If this value is set, then the tests within that merged test assembly will be run across N different work items instead of 1 when running under any form of GC stress based scenario. At this moment the largest supported value of N is 99
- Emit the testresults.xml file as a file which is exported from the tests. This is useful for debugging testresult.xml parsing failures
- Fix the testresults summary generator to never emit an empty CDATA string. If one is present the parser may fail the parse.
- In the XUnitWrapperGenerator fix the implementation of the Outerloop and ActiveIssue when used with a conditional member.
- Add PlatformDetection.IsMonoLLVMAOT, PlatformDetection.IsMonoLLVMFULLAOT, and PlatformDetection.IsMonoInterpreter boolean properties to the PlatformDetection type for use with the ActiveIssue attribute
- Add some documentation about project files for coreclr tests, as well as some documentation on the command line parameters for merged test runner assemblies
2022-11-07 16:19:53 -08:00
Armin Shoeibi f4a6849783
Retire .NET 5 (#69911) 2022-10-27 11:53:40 -07:00
Jan Kotas 3adbcf5ff9
Doc improvements (#76863)
- Use proper macOS capitalization
- Delete superfluous details

Co-authored-by: Theodore Tsirpanis <teo@tsirpanis.gr>
2022-10-11 13:35:53 -07:00
Ivan Diaz Sanchez 6811cc4dcb
Improvements to CoreCLR Building, Debugging, and Testing Documentation (#75569)
* Quality Week 2022: The First Step to a Better Documentation.

* Removed the Markdown Extension's additional development tags.

* Removed redundant stuff.

* Removed redundant stuff.

* Removed guide testing versions to avoid confusion that they would be the only supported versions.

* Addressed some Powershell comments, added a pointer to a yaml with links to other .NET sibling repos, and did a couple mini-corrections. Still got a few comments to address...

* Fixed a ';:' with Powershell's syntax.

* Addressed review comments: Redaction improvements, localization url's, improved code snippets, added info on individual subsets building configurations, changed COMPlus for DOTNET, and other misc improvements.

* Addressed remaining comments.

* Addressed some last comments regarding corerun, and the subset flags in the build scripts.

Co-authored-by: Ivan Diaz <bluehorizon186@gmail.com>
2022-10-10 13:39:22 -07:00
Will Smith 331dc3a0bb
Update disasm-checks documentation (#76286)
* Update disasm-checks documentation with limitations and future improvements

* Include not about anchors

* Update disasm-checks.md
2022-09-28 07:51:36 -07:00
Will Smith 7681692bdc
[JIT] CodeGen verification testing (#75102)
* Add test

* Add CHECKs

* Build scripts and test settings

* COMPlus -> DOTNET

* Fix filenames

* Missing >

* Missing quotes

* use %scriptPath%

* Rework properties, start two examples

* Arch demo

* Cleanup

* Remove tab

* Easier environment variables.  Undo precommand changes.

* undo blank line

* clean CHECKs

* Draft of bash

* Bash, conditionals

* More variables, start on run.cmd/sh/py

* another output

* Support in cmd/bash for RunningDisasmChecks

* copy, factor, formatting

* Initial work to include FileCheck. Added SuperFileCheck.

* Able to build SuperFileCheck

* Do not DisasmCheck TypeEquality_r for now. Update some FileChecks to follow SuperFileCheck rules.

* Partially wiring up SuperFileCheck to tests

* Piping list of method names from SuperFileCheck to JitDisasm

* Handling bash a little bit

* Moving SuperFileCheck to tests/Common

* Few tweaks

* Building SuperFileCheck as part of the test build

* Tweaking a few things

* Fixed a bug

* Moving SuperFileCheck back to src\coreclr\tools. Removed checks from TypeEquality_r.

* Restore original logic in Runtime_73681

* Trying to add CI leg for disasmchecks

* Use x64 package if x86 platform detected for JIT tools package

* Remove innerloop for disasmchecks

* Trying to fix build. Only run in Windows for now.

* Update Runtime_73681.cs

Trying to fail test

* Trying to fix build

* Update Runtime_73681.cs

* Update Runtime_73681.cs

* Fixing a few issues

* Trying to run disasmchecks as part of CI

* Trying to run disasmchecks

* Trying to run disasmchecks

* Trying to run disasmchecks

* Revert a change

* Trying to run disasmchecks

* Trying to run disasmchecks

* build SuperFileCheck on non-windows

* few tweaks

* Trying to fix CI

* Including SuperFileCheck for tests

* Cleanup

* More cleanup

* Cleanup

* Changed SuperFileCheck to not publish everything. Changed SuperFileCheck's lookup for FileCheck.

* Invoking SuperFileCheck using dotnet

* Making the test pass

* Only run disasm checks for coreclr and not mono

* Using HasBatchDisasmCheck and HasBashDisasmCheck to determine to run the check

* Enabling filecheck on linux and osx

* Added more comments

* Added ARM64 specific test. Do not run SuperFileCheck if no methods were found.

* Added documentation. Changed disasm-output.

* Minor doc tweak

* Minor doc tweak

* Minor doc tweak

* Minor doc tweak

* Minor doc tweak

* Cleanup. Trying to fix linux

* Fixing test

* Add information on additional functionality

* cleanup

* Add FileCheck snippet

* Undo environment variable changes

* Feedback from Mark

* Cleanup

* Trying to fix linux test run

* Trying to fix linux test run

* A few missing changes from the original branch

* Enable OSX for disasm checks

* cleanup / comment

* Force test failure

* Update Runtime_73681.cs

* Set env vars after errorlevel check

* Reverting back on setting environment variables in test. Added new FileCheck test for mod optimization

* Force a failure by changing the register

* Ignore native binaries for superpmi collect

* Update Runtime_34937.cs

* Force the correct failure

* Update Runtime_34937.cs

* Update Runtime_34937.cs

* Adding specific OS check prefixes. Changed dump-input context amount

* Added getting fully qualified method names with wildcards for SuperFileCheck

* More tests. Fixed a few issues with generics.

* Disabling generic support

* Error if it cannot find enclosing type declaration

* Fixing build

* Remove namespac

* Bring generics back, but in a limited form

Co-authored-by: Mark Plesko <markples@microsoft.com>
2022-09-23 15:31:05 -07:00
Nathan Ricci 4b1840b700
Updated test doc. (#75736) 2022-09-16 12:46:16 -05:00
Jan Kotas 32ac664fca
Replace net7 with net8 in dogfooding and workflow docs (#75453) 2022-09-12 20:40:44 -07:00
Ankit Jain ba3ee97687
[wasm] Move `src/tests/BuildWasmApps/*` to `src/mono/wasm` (#74698)
- This will help simplifying the path subsets in
`eng/pipelines/common/evaluate-default-paths.yml`, which would then help
to avoid a lot of unrelated non-wasm builds on PRs
2022-08-29 17:34:35 -04:00
Aleksey Kliger (λgeek) 4f835ae440
[docs] Debugging Libraries tests on Mono using VS Code (#73393)
* [docs] Debugging Libraries tests on Mono using VS Code

* markdown lint fixes

* A note about windows
2022-08-04 15:43:21 -04:00
Steve Pfister d7d0e421d7
[wasm] Modify workload to pick threading runtime packs (#72412)
* [wasm] Modify workload to pick threading runtime packs

This change adds the 2 wasm threading runtime packs to the wasm workload. In order for a threading runtime pack to be chosen, WorkloadManifest.targets is also modified to override the runtime pack name when the following props are set:

WasmEnableThreads - full threading support and will load Microsoft.NETCore.App.Runtime.multithread.Mono.browser-wasm

WasmEnablePerfTrace - runtime only threading support and will load Microsoft.NETCore.App.Runtime.perftrace.Mono.browser-wasm

* Add error condition when both WasmEnableThreading and WasmEnablePerfTrace are true

* [wasm] Set default value for MonoWasmBuildVariant, for runtime pack nuget

* [wasm] Wasm.Build.Tests: build runtime pack nugets with different names

- The earlier approach of simply making copies of the existing runtime
pack nuget with different names doesn't work, and `dotnet workload
install` rejects it.

```
  Installing pack Microsoft.NETCore.App.Runtime.Mono.multithread.browser-wasm version 7.0.0-ci...
  Workload installation failed. Rolling back installed packs...
```

Instead, now we build the missing nugets from the project with different
values for `$(MonoWasmBuildVariant)`.

- this handles local builds, and incremental builds also
- To skip building the missing nugets, for example, when you have all of
them available, then set `WasmSkipMissingRuntimePackBuild=true`.

* fix comment

Co-authored-by: Steve Pfister <steve.pfister@microsoft.com>
Co-authored-by: Ankit Jain <radical@gmail.com>
2022-07-27 12:08:59 -04:00
Adeel Mujahid 9d6396deb0
Fix typos (#72709) 2022-07-23 20:24:28 -07:00
Jan Kotas 0f75a0269c
Rename nightly to daily in the dogfood instructions (#71383)
Consistency with runtime and SDK download urls and other docs.
2022-06-28 09:27:58 -04:00
Filip Navara 2f38fb55e9
Fix unit test example (#70457) 2022-06-08 14:59:38 -07:00
Thays Grazia fd0a8e4b3b
Update testing-android.md (#70362) 2022-06-07 13:15:13 -03:00
Fan Yang 2fbc50fe92
[mono][doc] Update Android NDK version to r23c (#69913) 2022-05-31 09:39:51 -04:00
Elinor Fung e5f284401c
Add doc about using local build of apphost (#69097) 2022-05-10 14:24:38 -07:00
Bruce Forstall 0f3f7ea4d9
Add document describing how to disable tests (#68727)
* Add document describing how to disable tests

Update libraries "filtering tests" doc with information and examples for
using `SkipOnCoreClrAttribute`

* Update for feedback

Added SkipOnMonoAttribute, CollectionAttribute, an example
of using multiple SkipOnCoreClrAttribute, and how the xunit
attributes for test disabling apply to the "converted"
src/tests tree.
2022-05-03 10:56:34 -07:00
Andrew Au 3c7c9fb773
Make it easier to enable FEATURE_AUTO_TRACE (#63478) 2022-04-13 15:59:13 -07:00
Dan Moseley ac20efd2a2
fix pal test (#66636) 2022-03-16 14:56:01 -06:00