Repository navigation

[ENH] V1 → V2 API Migration - evaluations - #1606

Merged

PGijsbers merged 247 commits into

openml:mainfrom

EmanAbdelhaleem:evaluations-mig

Mar 24, 2026

Merged

[ENH] V1 → V2 API Migration - evaluations#1606
PGijsbers merged 247 commits into
openml:mainfrom
EmanAbdelhaleem:evaluations-mig

Commits on Dec 29, 2025
- changes made
  satvshr
  committed
  bf6e000
Commits on Dec 30, 2025
- set up folder structure and base code
  geetu040
  committed
  0159f47
- Merge branch 'issue1564' of https://github.com/satvshr/openml-python into issue1564
  satvshr
  committed
  8b6af81
- bug fixing
  satvshr
  committed
  834782c
- test failures fix
  satvshr
  committed
  38ae9be
- Update flow_id_tutorial.py
  satvshr
  committed
  93ab9c2
- _defaults bug fixing
  satvshr
  committed
  aa25dd6
Commits on Dec 31, 2025
- Merge branch 'main' into migration
  fkiraly
  authored
  58e9175
- removed __setattr__ given it is not supported
  satvshr
  committed
  a98b6b1
- Merge branch 'main' into issue1564
  satvshr
  authored
  7c82054
Commits on Jan 1, 2026
- Merge branch 'main' into migration
  geetu040
  authored
  bdd65ff
- Merge branch 'main' into issue1564
  satvshr
  authored
  f8fbe1e
Commits on Jan 2, 2026
- Merge branch 'main' into issue1564
  satvshr
  authored
  4fdcb64
Commits on Jan 4, 2026
- Merge branch 'main' into issue1564
  satvshr
  authored
  b3513f0
Commits on Jan 5, 2026
- fix pre-commit
  geetu040
  committed
  52ef379
- Update all files
  satvshr
  committed
  146dd21
- Update introduction_tutorial.py
  satvshr
  committed
  7a67bf0
Commits on Jan 7, 2026
- refactor
  geetu040
  committed
  5dfcbce
- implement cache_dir
  geetu040
  committed
  2acbe99
- refactor
  geetu040
  committed
  af99880
- Merge branch 'main' into pr/1577
  fkiraly
  committed
  b111905
- Merge branch 'issue1564' of https://github.com/satvshr/openml-python into pr/1577
  fkiraly
  committed
  83f36c2
- Merge branch 'main' into pr/1576
  fkiraly
  committed
  74ab366
Commits on Jan 12, 2026
- bug fixing
  satvshr
  committed
  4241624
- Update test_utils.py
  satvshr
  committed
  f01c1e9
- Update test_config.py
  satvshr
  committed
  07cc1c8
Commits on Jan 14, 2026
- merge main
  satvshr
  committed
  1dbc780
Commits on Jan 15, 2026
- undo changes in tasks/functions.py
  geetu040
  committed
  4c75e16
- Merge branch 'main' into migration
  geetu040
  committed
  5762185
- made requested changes
  satvshr
  committed
  021a1e1
- Merge branch 'main' into issue1564
  satvshr
  authored
  4c4a12c
- made requested changes
  satvshr
  committed
  1d91220
- Merge branch 'issue1564' of https://github.com/satvshr/openml-python into issue1564
  satvshr
  committed
  3e26ace
- fixed bugs
  satvshr
  committed
  0060b2e
- fixed bugs
  satvshr
  committed
  65ba66b
- fixed bugs
  satvshr
  committed
  317c6e9
- fixed bugs
  satvshr
  committed
  503ab82
Commits on Jan 16, 2026
- Merge branch 'main' into issue1564
  satvshr
  authored
  fd7ea2b
- bug fixing
  satvshr
  committed
  fa3cd40
Commits on Jan 21, 2026
- Merge branch 'main' into migration
  geetu040
  committed
  7e9bc1f
- add tests directory
  geetu040
  committed
  c603383
- use enum for delay method
  geetu040
  committed
  ff6a8b0
- implement cache
  geetu040
  committed
  f01898f
- refactor clients
  geetu040
  committed
  5c4511e
- Merge branch 'main' into issue1564
  fkiraly
  authored
  9d0098f
Commits on Jan 23, 2026
- fix import in resources/base.py
  geetu040
  committed
  43276d2
Commits on Jan 26, 2026
- refactor and add exception handling
  geetu040
  committed
  1206f69
- Merge branch 'main' into issue1564
  satvshr
  authored
  bde5942
- refactor resources/base/
  geetu040
  committed
  4948e99
- implement delete
  geetu040
  committed
  a354167
Commits on Jan 27, 2026
- implement publish and minor refactoring
  geetu040
  committed
  1fe7e3e
- implement tag/untag
  geetu040
  committed
  54a3151
- implement fallback
  geetu040
  committed
  2b6fe65
Commits on Jan 28, 2026
- add test_http.py
  geetu040
  committed
  fa53f8d
- add uses_test_server marker
  geetu040
  committed
  2b2db96
Commits on Jan 29, 2026
- [ENH] V1 → V2 API Migration - evaluations
  EmanAbdelhaleem
  committed
  a2fe0da
- update list function, remove circular imports
  EmanAbdelhaleem
  committed
  f7ab2e5
- Update list - sync PR
  EmanAbdelhaleem
  committed
  20f1247
- made get_users a private func
  EmanAbdelhaleem
  committed
  b6e54b3
- added tests
  EmanAbdelhaleem
  committed
  54f45cb
- sync with pr-1576
  EmanAbdelhaleem
  committed
  2f1eed5
- implement reset_cache
  geetu040
  committed
  c9617f9
- updated tests structure
  EmanAbdelhaleem
  committed
  f8f5452
- fixes with publish/delete
  geetu040
  committed
  5bc37b8
- fix cache_key in tests
  geetu040
  committed
  08d9916
Commits on Jan 30, 2026
- update _not_supported
  geetu040
  committed
  8caba11
- added fullback test
  EmanAbdelhaleem
  committed
  ee5d515
- add 'get_api_config' skeleton method
  SimonBlanke
  committed
  1913c10
- remove 'APISettings'
  SimonBlanke
  committed
  7681949
- impl. 'get_api_config'
  SimonBlanke
  committed
  01840a5
- add singleton pattern for settings
  SimonBlanke
  committed
  26ed4c1
- add 'reset_settings'
  SimonBlanke
  committed
  c588d0c
- remove unused code
  SimonBlanke
  committed
  b6ff720
- reimplement usage of v1 settings config
  SimonBlanke
  committed
  80d5afc
- first try v2, fallback to v1 if not available
  SimonBlanke
  committed
  f47112c
- reimplement singelton without the use of 'global'
  SimonBlanke
  committed
  d44cf3e
- add explanations
  SimonBlanke
  committed
  ea7dda1
- change usage of settings to new impl.
  SimonBlanke
  committed
  f0e5947
- add explanations
  SimonBlanke
  committed
  edcd006
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  cde0aae
Commits on Feb 1, 2026
- move to config: APIVersion, ResourceType
  geetu040
  committed
  aa1e560
- remove api_context entirely
  geetu040
  committed
  06b8497
- major refactor
  geetu040
  committed
  384da91
Commits on Feb 2, 2026
- more refactoring with setup/
  geetu040
  committed
  1878138
- implement APIBackend as controller
  geetu040
  committed
  dc26e01
- move enums
  geetu040
  committed
  e2d059b
- module level imports
  geetu040
  committed
  d156ad4
- module level import for _backend
  geetu040
  committed
  d7a3788
- module level import for tests
  geetu040
  committed
  b5b9ef6
- Merge branch 'main' into migration
  geetu040
  authored
  68820fe
- add test: test_tag_and_untag
  geetu040
  committed
  567eca4
Commits on Feb 3, 2026
- implement get/set_config_values
  geetu040
  committed
  b2287c3
- improve APIBackend.set_config_values
  geetu040
  committed
  b7e285e
- use LegacyConfig
  geetu040
  committed
  fd43c48
- Revert "use LegacyConfig"
  geetu040
  committed
  f4aab6b
- implement _sync_api_config
  geetu040
  committed
  d43cf86
- update tests with _sync_api_config
  geetu040
  committed
  3e323ed
- rename config: timeout -> timeout_seconds
  geetu040
  committed
  9195fa6
- use timedelta for default ttl value
  geetu040
  committed
  5342eec
- update tests, adds v2/fallback
  geetu040
  committed
  adc0e74
- add MinIOClient in TestBase
  geetu040
  committed
  bfb2d3e
- fix linting for builder
  geetu040
  committed
  cabaecf
- Merge branch 'pr-1576' into evaluations-mig
  EmanAbdelhaleem
  committed
  d1de0de
- increase timeout to 50 instead of 10
  EmanAbdelhaleem
  committed
  f7839a4
Commits on Feb 4, 2026
- fix unbound variables: "code", "message"
  geetu040
  committed
  85c1113
- use requests.Session()
  geetu040
  committed
  39bf86a
- remove "timeout_seconds" entirely
  geetu040
  committed
  7b66677
- Merge branch 'pr-1576' into evaluations-mig
  EmanAbdelhaleem
  committed
  b828c7e
- removed timeout_seconds from the v2 client
  EmanAbdelhaleem
  committed
  54bbb05
- update/refactor tests
  geetu040
  committed
  d2224c4
Commits on Feb 5, 2026
- remove unused current_api_version from TestAPIBase
  geetu040
  committed
  9608c36
- make TestAPIBase inherit TestBase
  geetu040
  committed
  f6bc7f7
- nits: test classes
  geetu040
  committed
  baa3a38
Commits on Feb 6, 2026
- minor fix in _sync_api_config
  geetu040
  committed
  52b93fe
- chore: rerun CI
  geetu040
  committed
  ec9477f
Commits on Feb 9, 2026
- Merge branch 'pr-1576' into evaluations-mig
  EmanAbdelhaleem
  committed
  e57d47a
- updated tests with the new design
  EmanAbdelhaleem
  committed
  29efbff
Commits on Feb 10, 2026
- remove duplicates in _api/resources/__init__.py
  geetu040
  committed
  10d134a
- implement HTTPClient.download and add tests
  geetu040
  committed
  935f0f4
Commits on Feb 11, 2026
- add docstrings
  geetu040
  committed
  9514df8
Commits on Feb 12, 2026
- update minio
  geetu040
  committed
  53bee94
Commits on Feb 13, 2026
- make delay functions static
  geetu040
  committed
  33b4ca0
- rename: retry_raise_e -> exception
  geetu040
  committed
  a6b9a45
- use context-manager for requests.Session
  geetu040
  committed
  f924b32
- remove "assert response is not None"
  geetu040
  committed
  541b0f2
- verify checksum before caching
  geetu040
  committed
  acb173f
- update tests
  geetu040
  committed
  3e8d1f0
- minor fix in ResourceV1API.untag
  geetu040
  committed
  f83bdb5
Commits on Feb 16, 2026
- update tests
  EmanAbdelhaleem
  committed
  5212164
- Merge branch 'pr-1576' into evaluations-mig
  EmanAbdelhaleem
  committed
  294d2e2
- remove cache.ttl
  geetu040
  committed
  2a42712
- replace config.cache.dir with config.cache_dir
  geetu040
  committed
  001caad
Commits on Feb 17, 2026
- make HTTPClient.cache compulsory
  geetu040
  committed
  fb38a2d
- remove unused OpenMLCacheRequiredError
  geetu040
  committed
  03c4ca9
- implement and use TestAPIBase._create_resource
  geetu040
  committed
  8d708fd
- make ResourceAPI.minio compulsory
  geetu040
  committed
  4f75bba
- Merge branch 'main' into migration
  geetu040
  authored
  164f66f
- rename: use_cache -> enable_cache; reset_cache -> refresh_cache
  geetu040
  committed
  c4dae43
- use server config from TestBase
  geetu040
  committed
  36c20a2
- tests: mock HTTP post calls to prevent race conditions
  geetu040
  committed
  ab3c1eb
Commits on Feb 18, 2026
- Merge branch 'main' into migration
  geetu040
  authored
  2a488ca
- remove hardcoded server in TestHTTPClient.test_cache
  geetu040
  committed
  599c7e1
- fix docstring in _resolve_default_cache_dir
  geetu040
  committed
  2867862
- fix docstring in ResourceAPI
  geetu040
  committed
  f09f3cd
- remove duplicates in __all__
  geetu040
  committed
  5f731ce
- remove ttl related code/docs
  geetu040
  committed
  bad7842
- remove delay methods in HTTPClient
  geetu040
  committed
  aefdb38
- minor fix in _resolve_default_cache_dir
  geetu040
  committed
  0f40b02
- update FallbackProxy
  geetu040
  committed
  7ac1672
- simplify _backend creation
  geetu040
  committed
  6ac1dfe
- Merge branch 'main' into migration
  geetu040
  authored
  62924c9
Commits on Feb 20, 2026
- req changes
  satvshr
  committed
  27696bb
- resolve conflicts
  satvshr
  committed
  190face
- remove old config file
  satvshr
  committed
  95daaa6
- added OPENML_TEST_SERVER_ADMIN_KEY_ENV_VAR
  satvshr
  committed
  7841ea8
- bug fixing
  satvshr
  committed
  cc515aa
- armagh fix
  satvshr
  committed
  e6a92df
- update content_type check
  geetu040
  committed
  1b8c22a
- Revert "make delay functions static"
  geetu040
  committed
  fc839a6
- Revert "remove delay methods in HTTPClient"
  geetu040
  committed
  1c922af
- Merge branch 'main' into migration
  geetu040
  authored
  ffa9ce9
- allow api_key=None
  geetu040
  committed
  a7b2d21
- add tests for api_key=None
  geetu040
  committed
  27fe790
Commits on Feb 23, 2026
- update cache not found message
  geetu040
  committed
  8965112
- update docs for path in HTTPCache
  geetu040
  committed
  72ea1a4
- remove elapsed from cached meta
  geetu040
  committed
  a696c49
- move self.headers to _HEADERS
  geetu040
  committed
  755636d
- fix indentation in docstrings of _resolve_default_cache_dir
  geetu040
  committed
  d07af34
- Update openml/_api/clients/http.py
  
  geetu040
  and
  mfeurer
  authored
  2d9c8ec
- Merge branch 'main' into migration
  geetu040
  authored
  002b989
- move _handle_delete_exception and_get_endpoint_name, legal_resources
  geetu040
  committed
  045d896
- set HTTPClient.headers
  geetu040
  committed
  c437966
- remove main_tag
  geetu040
  committed
  e27470a
- remove and merge TestAPIBase into TestBase
  geetu040
  committed
  d04d956
- minor change in TestHTTPClient.test_cache
  geetu040
  committed
  9263f7f
- make HTTPClient.request private
  geetu040
  committed
  79dea29
- Revert "update FallbackProxy"
  geetu040
  committed
  f6497c2
- use st_ctime instead of st_ctime for cache refresh test
  geetu040
  committed
  dce7f54
Commits on Feb 24, 2026
- Merge branch 'main' into issue1564
  geetu040
  authored
  40dd460
- majore config refactor
  geetu040
  committed
  0fc917c
- Merge branch 'pr-1577' into migration
  geetu040
  committed
  3d86b18
- update _config.py
  geetu040
  committed
  aba3d3e
- update test_openml_cache_dir_env_var
  geetu040
  committed
  d99d54d
Commits on Feb 25, 2026
- fix mutable SERVERS_REGISTRY
  geetu040
  committed
  dc22e3a
- update set_api_version for fallback
  geetu040
  committed
  7318573
- minor fix
  geetu040
  committed
  29ef187
- fixes for test_config
  geetu040
  committed
  cf94c89
- fixes in conftest urls
  geetu040
  committed
  298fbda
- update test_http.py
  geetu040
  committed
  9870502
- undo changes with test_openml_cache_dir_env_var
  geetu040
  committed
  33065c2
- fix server mode in test_config.py
  geetu040
  committed
  76b92bb
- move _HEADERS to confing
  geetu040
  committed
  419edcb
- add fixtures for migration tests
  geetu040
  committed
  cb6d937
- update test_http.py with fixtures
  geetu040
  committed
  8544c8a
- update test_versions.py
  geetu040
  committed
  d4c413b
- update test_versions.py
  geetu040
  committed
  fab1a15
Commits on Feb 26, 2026
- fix error message in HTTPClient.server
  geetu040
  committed
  276324a
- fixes in test_versions.py: use DummyTaskAPI instead of TaskAPI
  geetu040
  committed
  73f7594
- add clients in openml._backend
  geetu040
  committed
  2ee7fa3
- Merge branch 'pr-1576' into evaluations-mig
  EmanAbdelhaleem
  committed
  f403366
- update tests
  EmanAbdelhaleem
  committed
  ce8f5f9
- fixes with openml.config.[server|apikey] leakage
  geetu040
  committed
  4be5bbd
- remove unused fixtures: use_api_[v1|v2]
  geetu040
  committed
  9027c01
Commits on Feb 27, 2026
- add more config tests
  geetu040
  committed
  e5461a9
- make SERVERS_REGISTRY private
  geetu040
  committed
  7d899a9
- fix marker: uses_test_server->test_server
  geetu040
  committed
  8587414
- fix UserWarning
  geetu040
  committed
  23a3450
- update fixture: with_server
  geetu040
  committed
  ac28f82
Commits on Mar 2, 2026
- req changes
  satvshr
  committed
  4a66245
- Merge branch 'issue1564' of https://github.com/satvshr/openml-python into issue1564
  satvshr
  committed
  c762fb4
Commits on Mar 4, 2026
- Update openml/_api/clients/http.py
  
  geetu040
  and
  PGijsbers
  authored
  77c21f2
- Update tests/test_api/test_http.py
  
  geetu040
  and
  PGijsbers
  authored
  eac24fc
- update test_get_uses_cached_response
  geetu040
  committed
  2ed65fe
- test_get_with_api_key
  geetu040
  committed
  f3b07de
- use .arff instead of .bin in tests
  geetu040
  committed
  29db3f1
- update test_download_creates_file to use md5_checksum
  geetu040
  committed
  3b4e538
- update test_download_is_cached_on_disk
  geetu040
  committed
  8ac886b
- update APIBackendBuilder
  geetu040
  committed
  305f4f0
- Merge branch 'main' into migration
  geetu040
  authored
  b2bf164
- Update openml/_api/clients/http.py
  
  geetu040
  and
  PGijsbers
  authored
  e97e6c2
- [pre-commit.ci] auto fixes from pre-commit.com hooks
  pre-commit-ci[bot]
  committed
  c66d73c
- pre-commit fixes
  geetu040
  committed
  aa54e8e
Commits on Mar 6, 2026
- Merge branch 'main' into issue1564
  geetu040
  authored
  2d452d3
- Merge branch 'main' into issue1564
  fkiraly
  authored
  c235812
- Trigger CI
  satvshr
  committed
  39eb823
- Merge branch 'main' into migration
  geetu040
  authored
  50eed37
Commits on Mar 10, 2026
- Merge branch 'main' into issue1564
  geetu040
  authored
  7a000eb
- Merge branch 'main' into issue1564
  geetu040
  authored
  79f6187
Commits on Mar 12, 2026
- Merge branch 'pr-1577' into migration (merge conflicts)
  geetu040
  committed
  b1a9e7f
- update server methods in config
  geetu040
  committed
  d716ecf
- fix api-version leakage in tests
  geetu040
  committed
  3c29e71
- remove unused migration code
  geetu040
  committed
  b4ff0b2
- debug ci: separate cache for each test-case
  geetu040
  committed
  93155ee
- update port for localhost
  geetu040
  committed
  d3cc9a7
- Revert "debug ci: separate cache for each test-case"
  geetu040
  committed
  a6b82f4
- rerun CI
  geetu040
  committed
  3419973
- Merge branch 'main' into migration
  geetu040
  committed
  8de99b7
Commits on Mar 16, 2026
- create enum ServerMode
  geetu040
  committed
  7d61107
- update config for ServerMode
  geetu040
  committed
  1ecbbba
- update tests for ServerMode
  geetu040
  committed
  65472ed
Commits on Mar 17, 2026
- udpate apikey in _TEST_SERVERS_LOCAL
  geetu040
  committed
  44b48b5
- Merge branch 'migration' into evaluations-mig
  geetu040
  committed
  601867f
Commits on Mar 23, 2026
- fix marker
  geetu040
  committed
  783dff9
- fix: remove duplicate server name in cache path
  geetu040
  committed
  04bc83b
- test: remove check for ":" since windows CI expects it
  geetu040
  committed
  f926092
- Merge branch 'migration' into evaluations-mig
  geetu040
  committed
  96ff8dd
- Merge branch 'main' into evaluations-mig
  geetu040
  committed
  e8537df

Commits

Commits on Dec 29, 2025

Commits on Dec 30, 2025

Commits on Dec 31, 2025

Commits on Jan 1, 2026

Commits on Jan 2, 2026

Commits on Jan 4, 2026

Commits on Jan 5, 2026

Commits on Jan 7, 2026

Commits on Jan 12, 2026

Commits on Jan 14, 2026

Commits on Jan 15, 2026

Commits on Jan 16, 2026

Commits on Jan 21, 2026

Commits on Jan 23, 2026

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Commits on Jan 28, 2026

Commits on Jan 29, 2026

Commits on Jan 30, 2026

Commits on Feb 1, 2026

Commits on Feb 2, 2026

Commits on Feb 3, 2026

Commits on Feb 4, 2026

Commits on Feb 5, 2026

Commits on Feb 6, 2026

Commits on Feb 9, 2026

Commits on Feb 10, 2026