[MNT] Standardize pytest markers and update documentation

- Rename 'uses_test_server' to 'test_server' globally.
- Standardize 'production' to 'production_server' in documentation and CI.
- Register new markers and remove unused 'server' marker in pyproject.toml.
- Fix indentation in pyproject.toml markers list.
- Update 'docs/developer_setup.md' with new markers and examples.
- Remove redundant marker registration in 'tests/conftest.py'.

Author: AniruthKarthik

.github/workflows/test.yml

@@ -114,9 +114,9 @@ jobs:
         fi
 
         if [ "${{ matrix.sklearn-only }}" = "true" ]; then
-          marks="sklearn and not production_server and not uses_test_server"
+          marks="sklearn and not production_server and not test_server"
         else
-          marks="not production_server and not uses_test_server"
+          marks="not production_server and not test_server"
         fi
 
         pytest -n 4 --durations=20 --dist load -sv $codecov -o log_cli=true -m "$marks"
@@ -131,9 +131,9 @@ jobs:
         fi
 
         if [ "${{ matrix.sklearn-only }}" = "true" ]; then
-          marks="sklearn and production_server and not uses_test_server"
+          marks="sklearn and production_server and not test_server"
         else
-          marks="production_server and not uses_test_server"
+          marks="production_server and not test_server"
         fi
 
         pytest -n 4 --durations=20 --dist load -sv $codecov -o log_cli=true -m "$marks"
@@ -143,7 +143,7 @@ jobs:
       env:
         OPENML_TEST_SERVER_ADMIN_KEY: ${{ secrets.OPENML_TEST_SERVER_ADMIN_KEY }}
       run: |  # we need a separate step because of the bash-specific if-statement in the previous one.
-        pytest -n 4 --durations=20 --dist load -sv --reruns 5 --reruns-delay 1 -m "not uses_test_server"
+        pytest -n 4 --durations=20 --dist load -sv --reruns 5 --reruns-delay 1 -m "not test_server"
 
     - name: Check for files left behind by test
       if: matrix.os != 'windows-latest' && always()

docs/developer_setup.md

@@ -170,8 +170,8 @@ The OpenML Python SDK utilizes `pytest` markers to categorize tests based on dep
 | Marker            | Description                                                                 |
 |-------------------|-----------------------------------------------------------------------------|
 | `sklearn`          | Tests requiring `scikit-learn`. Skipped if the library is missing.          |
-| `production`      | Tests that interact with the live OpenML server (real API calls).         |
-| `uses_test_server`  | Tests requiring the OpenML test server environment.                       |
+| `production_server`| Tests that interact with the live OpenML server (real API calls).         |
+| `test_server`     | Tests requiring the OpenML test server environment.                       |
 
 ### Execution Examples
 
@@ -190,7 +190,7 @@ pytest -m sklearn
 Exclude production tests (local only):
 
 ```bash
-pytest -m "not production"
+pytest -m "not production_server"
 ```
 
 ### Admin Privilege Tests

pyproject.toml

@@ -134,8 +134,7 @@ filterwarnings=[
 ]
 markers = [
   "upload: anything that uploads to a server",
-      "production_server: any interaction with the production server",
-  
+  "production_server: any interaction with the production server",
   "cache: anything that interacts with the (test) cache",
   "test_server: tests that require the OpenML test server",
 ]

tests/conftest.py

@@ -189,7 +189,6 @@ def pytest_sessionfinish() -> None:
 
 def pytest_configure(config):
     config.addinivalue_line("markers", "sklearn: marks tests that use scikit-learn")
-    config.addinivalue_line("markers", "production_server: marks tests that use the production server")
 
 
 def pytest_addoption(parser):