Repository navigation

Enhance SEA HTTP Client - #618

Merged

varun-edachali-dbx merged 453 commits into

mainfrom

sea-http-client

Aug 4, 2025

Merged

Enhance SEA HTTP Client #618
varun-edachali-dbx merged 453 commits into
mainfrom
sea-http-client

This pull request is big! We're only showing the most recent 250 commits

Commits on Jun 18, 2025
Commits on Jun 19, 2025
- add from __future__ import annotations to remove string literals around forward refs, remove some unused imports
  varun-edachali-dbx
  committed
  d759050
Commits on Jun 20, 2025
- remove verbosity in ResultSetFilter docstring
  
  varun-edachali-dbx
  and
  jayantsing-db
  authored
  3578659
- remove un-necessary info in ResultSetFilter docstring
  varun-edachali-dbx
  committed
  8713023
- remove explicit type checking, string literals around forward annotations
  varun-edachali-dbx
  committed
  22dc252
- house SQL commands in constants
  varun-edachali-dbx
  committed
  390f592
Commits on Jun 23, 2025
- convert complex types to string if not _use_arrow_native_complex_types
  varun-edachali-dbx
  committed
  dd7dc6a
- Merge branch 'metadata-sea' into fetch-json-inline
  varun-edachali-dbx
  committed
  28308fe
- introduce unit tests for altered functionality
  varun-edachali-dbx
  committed
  2712d1c
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  dabba55
- Revert "Merge branch 'fetch-json-inline' into ext-links-sea"
  varun-edachali-dbx
  committed
  48ad7b3
- reduce verbosity of ResultSetFilter docstring
  varun-edachali-dbx
  committed
  a1f9b9c
- remove unused imports
  varun-edachali-dbx
  committed
  984e8ee
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  3a999c0
- Revert "Merge branch 'fetch-json-inline' into ext-links-sea"
  varun-edachali-dbx
  committed
  c313c2b
- Revert "reduce verbosity of ResultSetFilter docstring"
  varun-edachali-dbx
  committed
  3bc615e
- Reapply "Merge branch 'fetch-json-inline' into ext-links-sea"
  varun-edachali-dbx
  committed
  b6e1a10
- Revert "Merge branch 'fetch-json-inline' into ext-links-sea"
  varun-edachali-dbx
  committed
  2df3d39
- remove un-necessary filters changes
  varun-edachali-dbx
  committed
  5e75fb5
- remove un-necessary backend changes
  varun-edachali-dbx
  committed
  20822e4
- remove constants changes
  varun-edachali-dbx
  committed
  802d045
- remove changes in filters tests
  varun-edachali-dbx
  committed
  f3f795a
- remove unit test backend and JSON queue changes
  varun-edachali-dbx
  committed
  f6c5950
- remove changes in sea result set testing
  varun-edachali-dbx
  committed
  d210ccd
- Revert "remove changes in sea result set testing"
  varun-edachali-dbx
  committed
  22a953e
- Revert "remove unit test backend and JSON queue changes"
  varun-edachali-dbx
  committed
  3aed144
- Revert "remove changes in filters tests"
  varun-edachali-dbx
  committed
  0fe4da4
- Revert "remove constants changes"
  varun-edachali-dbx
  committed
  0e3c0a1
- Revert "remove un-necessary backend changes"
  varun-edachali-dbx
  committed
  93edb93
- Revert "remove un-necessary filters changes"
  varun-edachali-dbx
  committed
  871a44f
- remove unused imports
  varun-edachali-dbx
  committed
  0ce144d
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  08ca60d
- working version
  varun-edachali-dbx
  committed
  8c5cc77
- adopy _wait_until_command_done
  varun-edachali-dbx
  committed
  7f5c715
- introduce metadata commands
  varun-edachali-dbx
  committed
  9ef5fad
- use new backend structure
  varun-edachali-dbx
  committed
  44183db
- constrain backend diff
  varun-edachali-dbx
  committed
  d59b351
- remove changes to filters
  varun-edachali-dbx
  committed
  1edc80a
- make _parse methods in models internal
  varun-edachali-dbx
  committed
  f82658a
- reduce changes in unit tests
  varun-edachali-dbx
  committed
  54eb0a4
Commits on Jun 24, 2025
- run small queries with SEA during integration tests
  varun-edachali-dbx
  committed
  50cc1e2
- run some tests for sea
  varun-edachali-dbx
  committed
  242307a
- move docstring of DatabricksClient within class
  varun-edachali-dbx
  committed
  1e21434
- move ThriftResultSet import to top of file
  varun-edachali-dbx
  committed
  cd4015b
- make backend/utils __init__ file empty
  varun-edachali-dbx
  committed
  ed8b610
- use from __future__ import annotations to remove string literals around Cursor
  varun-edachali-dbx
  committed
  94d951e
- use lazy logging
  varun-edachali-dbx
  committed
  c20058e
- replace getters with property tag
  varun-edachali-dbx
  committed
  fe3acb1
- Merge branch 'main' into backend-refactors
  varun-edachali-dbx
  committed
  9fb6a76
- set active_command_id to None, not active_op_handle
  varun-edachali-dbx
  committed
  61dfc4d
- align test_session with pytest instead of unittest
  varun-edachali-dbx
  committed
  64fb9b2
Commits on Jun 25, 2025
- allow empty schema bytes for alignment with SEA
  varun-edachali-dbx
  committed
  8a138e8
- pass is_vl_op to Sea backend ExecuteResponse
  varun-edachali-dbx
  committed
  82f9d6b
Commits on Jun 26, 2025
- remove catalog requirement in get_tables
  varun-edachali-dbx
  committed
  35f1ef0
- move filters.py to SEA utils
  varun-edachali-dbx
  committed
  a515d26
- ensure SeaResultSet
  varun-edachali-dbx
  committed
  59b1330
- Merge branch 'main' into sea-migration
  varun-edachali-dbx
  committed
  cbf63f9
- remove duplicate test, correct active_command_id attribute
  varun-edachali-dbx
  committed
  59b4825
- Merge branch 'sea-migration' into metadata-sea
  varun-edachali-dbx
  committed
  293e356
- prevent circular imports
  varun-edachali-dbx
  committed
  dd40beb
- remove unused imports
  varun-edachali-dbx
  committed
  14057ac
- remove cast, throw error if not SeaResultSet
  varun-edachali-dbx
  committed
  a4d5bdb
- Merge branch 'metadata-sea' into fetch-json-inline
  varun-edachali-dbx
  committed
  156421a
- pass param as TSparkParameterValue
  varun-edachali-dbx
  committed
  eb1a9b4
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  9000666
- remove failing test (temp)
  varun-edachali-dbx
  committed
  a3ca7c7
- remove SeaResultSet type assertion
  varun-edachali-dbx
  committed
  2c22010
- change errors to align with spec, instead of arbitrary ValueError
  varun-edachali-dbx
  committed
  c09508e
- make SEA backend methods return SeaResultSet
  varun-edachali-dbx
  committed
  e9b1314
- use spec-aligned Exceptions in SEA backend
  varun-edachali-dbx
  committed
  8ede414
- remove defensive row type check
  varun-edachali-dbx
  committed
  09a1b11
- SeaDatabricksClient: Add Metadata Commands (#593)
  
  varun-edachali-dbx
  and
  jayantsing-db
  authored
  e380654
- SEA volume operations fix: assign `manifest.is_volume_operation` to `is_staging_operation` in `ExecuteResponse` (#610)
  varun-edachali-dbx
  authored
  677a7b0
- Merge branch 'metadata-sea' into fetch-json-inline
  varun-edachali-dbx
  committed
  5e01e7b
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  3becefe
- raise ProgrammingError for invalid id
  varun-edachali-dbx
  committed
  a026d31
- make is_volume_operation strict bool
  varun-edachali-dbx
  committed
  4446a9e
- remove complex types code
  varun-edachali-dbx
  committed
  138359d
- Revert "remove complex types code"
  varun-edachali-dbx
  committed
  b99d0c4
Commits on Jun 27, 2025
- introduce type conversion for primitive types for JSON + INLINE
  varun-edachali-dbx
  committed
  21c389d
- Merge branch 'sea-migration' into fetch-json-inline
  varun-edachali-dbx
  committed
  734321a
- remove SEA running on metadata queries (known failures
  varun-edachali-dbx
  committed
  9f0f969
- remove un-necessary docstrings
  varun-edachali-dbx
  committed
  04a1936
- preliminary (robust) SEA HTTP Client
  varun-edachali-dbx
  committed
  11bc165
- prevent catching of MaxRetryError and HttpError in client
  varun-edachali-dbx
  committed
  d389316
- formatting (black)
  varun-edachali-dbx
  committed
  cc48caf
- fix type annotations
  varun-edachali-dbx
  committed
  6a1274f
- align expected types with databricks sdk
  varun-edachali-dbx
  committed
  278b8cd
- link rest api reference to validate types
  varun-edachali-dbx
  committed
  91b7f7f
- remove test_catalogs_returns_arrow_table test
  varun-edachali-dbx
  committed
  7a5ae13
- fix fetchall_arrow and fetchmany_arrow
  varun-edachali-dbx
  committed
  f1776f3
- remove thrift aligned test_cancel_during_execute from SEA tests
  varun-edachali-dbx
  committed
  6143331
- Introduce manual SEA test scripts for Exec Phase (#589)
  varun-edachali-dbx
  authored
  45585d4
- Merge branch 'sea-migration' into fetch-json-inline
  varun-edachali-dbx
  committed
  8949d0c
- remove un-necessary changes in example scripts
  varun-edachali-dbx
  committed
  5eaded4
- remove un-necessary chagnes in example scripts
  varun-edachali-dbx
  committed
  eeed9a1
- _convert_json_table -> _create_json_table
  varun-edachali-dbx
  committed
  f233886
- remove accidentally removed test
  varun-edachali-dbx
  committed
  68ac437
- remove new unit tests (to be re-added based on new arch)
  varun-edachali-dbx
  committed
  7fd0845
- remove changes in sea_result_set functionality (to be re-added)
  varun-edachali-dbx
  committed
  ea7ff73
- introduce more integration tests
  varun-edachali-dbx
  committed
  563da71
- remove SEA tests in parameterized queries
  varun-edachali-dbx
  committed
  a018273
- remove partial parameter fix changes
  varun-edachali-dbx
  committed
  c0e98f4
- remove un-necessary timestamp tests
  varun-edachali-dbx
  committed
  7343035
- slightly stronger typing of _convert_json_types
  varun-edachali-dbx
  committed
  ec500b6
- stronger typing of json utility func s
  varun-edachali-dbx
  committed
  0b3e91d
- stronger typing of fetch*_json
  varun-edachali-dbx
  committed
  7664e44
- remove unused helper methods in SqlType
  varun-edachali-dbx
  committed
  db7b8e5
- line breaks after multi line pydocs, remove excess logs
  varun-edachali-dbx
  committed
  f75f2b5
- line breaks after multi line pydocs, reduce diff of redundant changes
  varun-edachali-dbx
  committed
  e2d4ef5
- reduce diff of redundant changes
  varun-edachali-dbx
  committed
  21e3078
- mandate ResultData in SeaResultSet constructor
  varun-edachali-dbx
  committed
  bb015e6
- Merge branch 'fetch-json-inline' into ext-links-sea
  varun-edachali-dbx
  committed
  3944e39
- remove complex type conversion
  varun-edachali-dbx
  committed
  b3273c7
- correct fetch*_arrow
  varun-edachali-dbx
  committed
  38c2b88
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  ebc1915
Commits on Jun 30, 2025
Commits on Jul 1, 2025
- return empty JsonQueue if no data
  varun-edachali-dbx
  committed
  01d49cd
Commits on Jul 2, 2025
- do not preload content?
  varun-edachali-dbx
  committed
  3d8aa7f
- Complete Fetch Phase (for `INLINE` disposition and `JSON_ARRAY` format) (#594)
  varun-edachali-dbx
  authored
  70c7dc8
Commits on Jul 3, 2025
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  b77acbe
- recover old sea tests
  varun-edachali-dbx
  committed
  fa2359d
- move queue and result set into SEA specific dir
  varun-edachali-dbx
  committed
  c07f709
- pass ssl_options into CloudFetchQueue
  varun-edachali-dbx
  committed
  9e4ef2e
- reduce diff
  varun-edachali-dbx
  committed
  b00c06c
- remove redundant conversion.py
  varun-edachali-dbx
  committed
  10f55f0
- fix type issues
  varun-edachali-dbx
  committed
  cd119e9
- ValueError not ProgrammingError
  varun-edachali-dbx
  committed
  d79638b
- reduce diff
  varun-edachali-dbx
  committed
  f84578a
- introduce SEA cloudfetch e2e tests
  varun-edachali-dbx
  committed
  c621c0c
- allow empty cloudfetch result
  varun-edachali-dbx
  committed
  7958cd9
- add unit tests for CloudFetchQueue and SeaResultSet
  varun-edachali-dbx
  committed
  e2d17ff
- skip pyarrow dependent tests
  varun-edachali-dbx
  committed
  d348b35
- Merge branch 'main' into sea-migration
  varun-edachali-dbx
  committed
  abf9aab
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  811205e
- Merge branch 'main' into backend-refactors
  varun-edachali-dbx
  committed
  9b4b606
Commits on Jul 4, 2025
- simplify download process: no pre-fetching
  varun-edachali-dbx
  committed
  4bd290e
- correct class name in logs
  varun-edachali-dbx
  committed
  dfbbf79
Commits on Jul 7, 2025
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  b12a8b0
- Introduce `row_limit` param (#607)
  varun-edachali-dbx
  authored
  4f11ff0
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  ed4d7ab
- add sea tag on large queries
  varun-edachali-dbx
  committed
  51aa9be
- align with old impl
  varun-edachali-dbx
  committed
  a5e9cdf
- align next_n_rows with prev imple
  varun-edachali-dbx
  committed
  be16634
- align remaining_rows with prev impl
  varun-edachali-dbx
  committed
  6ec8656
- remove un-necessary Optional params
  varun-edachali-dbx
  committed
  7ea7b75
- remove un-necessary changes in thrift field if tests
  varun-edachali-dbx
  committed
  64be07b
- remove unused imports
  varun-edachali-dbx
  committed
  165644c
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  3172ab8
- simplify error handling
  varun-edachali-dbx
  committed
  461e762
Commits on Jul 8, 2025
- stop mypy complaints
  varun-edachali-dbx
  committed
  fd1e6cf
- run large queries
  varun-edachali-dbx
  committed
  abef941
- run retry tests
  varun-edachali-dbx
  committed
  15378de
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  83de7d9
Commits on Jul 10, 2025
- Merge branch 'main' into backend-refactors
  varun-edachali-dbx
  committed
  45f5c26
- formatting (black)
  varun-edachali-dbx
  committed
  2c9368a
- remove repetition from Session.__init__
  varun-edachali-dbx
  committed
  9b1b1f5
Commits on Jul 11, 2025
- move link fetching immediately before table creation so link expiry is not an issue
  varun-edachali-dbx
  committed
  fce324b
- Merge branch 'backend-refactors' into sea-migration
  varun-edachali-dbx
  committed
  77e23d3
- fix merge artifacts
  varun-edachali-dbx
  committed
  3bd3aef
- correct patch paths
  varun-edachali-dbx
  committed
  6d4701f
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  39469fa
- formatting (black)
  varun-edachali-dbx
  committed
  b2d1579
- fix types
  varun-edachali-dbx
  committed
  077a71c
- fix param type in unit tests
  varun-edachali-dbx
  committed
  7985639
Commits on Jul 14, 2025
- fix type issues
  varun-edachali-dbx
  committed
  dc1cb6d
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  dfc32b4
- correct param extraction
  varun-edachali-dbx
  committed
  0a0643b
- remove common constructor for databricks client abc
  varun-edachali-dbx
  committed
  f7fd1d9
- make SEA Http Client instance a private member
  varun-edachali-dbx
  committed
  510b0a3
- make GetChunksResponse model more robust
  varun-edachali-dbx
  committed
  dd2864b
- add link to doc of GetChunk response model
  varun-edachali-dbx
  committed
  c32b281
- pass result_data instead of "initial links" into SeaCloudFetchQueue
  varun-edachali-dbx
  committed
  0b1eba5
- move download_manager init into parent CloudFetchQueue
  varun-edachali-dbx
  committed
  777f7c1
- raise ServerOperationError for no 0th chunk
  varun-edachali-dbx
  committed
  130b0d3
- unused iports
  varun-edachali-dbx
  committed
  1920375
Commits on Jul 15, 2025
- Merge branch 'main' into sea-migration
  varun-edachali-dbx
  committed
  5d04cd0
- explicitly close result queue
  varun-edachali-dbx
  committed
  922c448
- Merge branch 'sea-migration' into ext-links-sea
  varun-edachali-dbx
  committed
  d882c6e
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  7fb59e4
- simplify HTTP client using requests.session
  varun-edachali-dbx
  committed
  25596e7
- explicitly close response object
  varun-edachali-dbx
  committed
  2124fe0
- formatting (black)
  varun-edachali-dbx
  committed
  404aadf
- remove excess changes
  varun-edachali-dbx
  committed
  01c9b95
- return None in case of empty respose
  varun-edachali-dbx
  committed
  5a43686
- ensure table is empty on no initial link s
  varun-edachali-dbx
  committed
  28c6bb1
- Merge branch 'ext-links-sea' into sea-http-client
  varun-edachali-dbx
  committed
  41f1130
Commits on Jul 16, 2025
Commits on Jul 17, 2025
- pass error as 4th arg, not 3rd
  varun-edachali-dbx
  committed
  7143eff
- add warning for legacy behaviour
  varun-edachali-dbx
  committed
  e3528a1
- simplify error handling (attempt)
  varun-edachali-dbx
  committed
  112958d
- cleaner HTTP client using requests.sessions
  varun-edachali-dbx
  committed
  b7a4677
- SEA: add support for `Hybrid` disposition (#631)
  varun-edachali-dbx
  authored
  640cc82
- Revert "cleaner HTTP client using requests.sessions"
  varun-edachali-dbx
  committed
  3b8e1ad
- clean up response (implicitly by using with)
  varun-edachali-dbx
  committed
  c227739
Commits on Jul 19, 2025
Commits on Jul 21, 2025
- SEA: Decouple Link Fetching (#632)
  varun-edachali-dbx
  authored
  806e5f5
- Chunk download latency (#634)
  saishreeeee
  authored
  b57c3f3
- acquire lock before notif + formatting (black)
  varun-edachali-dbx
  committed
  ef5836b
Commits on Jul 23, 2025
- Merge branch 'main' into sea-migration
  varun-edachali-dbx
  committed
  4fd2a3f
- fix imports
  varun-edachali-dbx
  committed
  26f8947
- add get_chunk_link s
  varun-edachali-dbx
  committed
  2d44596
- simplify description extraction
  varun-edachali-dbx
  committed
  99e7435
- pass session_id_hex to ThriftResultSet
  varun-edachali-dbx
  committed
  54ec080
- revert to main's extract description
  varun-edachali-dbx
  committed
  f9f9f31
- validate row count for sync query tests as well
  varun-edachali-dbx
  committed
  51cef2b
- guid_hex -> hex_guid
  varun-edachali-dbx
  committed
  387102d
- reduce diff
  varun-edachali-dbx
  committed
  d53d1ea
- reduce diff
  varun-edachali-dbx
  committed
  c7810aa
- reduce diff
  varun-edachali-dbx
  committed
  b3072bd
- set .value in compression
  varun-edachali-dbx
  committed
  8be5264
- reduce diff
  varun-edachali-dbx
  committed
  80692e3
- Merge branch 'main' into sea-http-client
  varun-edachali-dbx
  committed
  f810ac1
- formatting (black)
  varun-edachali-dbx
  committed
  5a13925
- remove redundant test
  varun-edachali-dbx
  committed
  92ba484
- move extra_params to the back
  varun-edachali-dbx
  committed
  2d451b6
Commits on Jul 24, 2025
- Merge branch 'sea-migration' into sea-http-client
  varun-edachali-dbx
  committed
  971969a
Commits on Jul 25, 2025
- is_direct_results -> has_more_rows
  varun-edachali-dbx
  committed
  0e87374
- Revert "is_direct_results -> has_more_rows"
  varun-edachali-dbx
  committed
  20c705f
Commits on Jul 28, 2025
- Merge branch 'main' into sea-http-client
  varun-edachali-dbx
  committed
  2201765
- stop passing session_id_hex
  varun-edachali-dbx
  committed
  f277b07
- remove redundant comment
  varun-edachali-dbx
  committed
  e58b6b5
- add extra_params param
  varun-edachali-dbx
  committed
  9e086af
- pass extra_params into test_...unset...
  varun-edachali-dbx
  committed
  9cfa350
- remove excess session_id_he
  varun-edachali-dbx
  committed
  878a845
Commits on Jul 31, 2025
- reduce changes in DatabricksRetryPolicy
  varun-edachali-dbx
  committed
  071ad4e
- reduce diff in DatabricksRetryPolicy
  varun-edachali-dbx
  committed
  de339c0
- simple comments on proxy setting
  varun-edachali-dbx
  committed
  2edff78
- link docs for getproxies)(
  varun-edachali-dbx
  committed
  6c5b37f
Commits on Aug 4, 2025
- Merge branch 'main' into sea-http-client
  varun-edachali-dbx
  committed
  328c3bd
- rename proxy specific attrs with proxy prefix
  varun-edachali-dbx
  committed
  dba08cd

Commits

Commits on Jun 18, 2025

Commits on Jun 19, 2025

Commits on Jun 20, 2025

Commits on Jun 23, 2025

Commits on Jun 24, 2025

Commits on Jun 25, 2025

Commits on Jun 26, 2025

Commits on Jun 27, 2025

Commits on Jun 30, 2025

Commits on Jul 1, 2025

Commits on Jul 2, 2025

Commits on Jul 3, 2025