connector.databricks 0.2.0
- Add new class
ConnectorDatabricksSQL which uses
brickster::DatabricksSQL() as a driver. This class will
replace ConnectorDatabricksTable as preferred way of
working with tables in Databricks. This driver will be using SQL
Warehouse instead of Compute Cluster, which was used by
odbc driver.
connector_databricks_sql() and
ConnectorDatabricksSQL are no longer marked as
experimental.
- README, getting started vignette and the example configuration in
inst/config/example_yaml.yaml now use
connector_databricks_sql(). The reading and writing article
covers ConnectorDatabricksSQL, a new article compares
ConnectorDatabricksSQL and
ConnectorDatabricksTable, and a new authentication article
explains how brickster and odbc find credentials locally, on Posit
Workbench and on Posit Connect #104.
connector_databricks_table() and
ConnectorDatabricksTable$new() gain ...,
passed on to DBI::dbConnect() for the
odbc::databricks() driver, so driver parameters such as
workspace, uid, pwd or
useNativeQuery can be set #109.
extra_class now has to be passed by name.
- Update dependency on
brickster version >=
0.2.14.
- Fix #105
list_content_cnt() for
ConnectorDatabricksTable returning NULL with
brickster >= 0.2.14, where db_uc_tables_list() now
returns a paginated response with a tables element. Results
from all pages are now collected.
- Fix #99
support for working with volumes with read-only permissions.
connector.databricks 0.1.0
connector.databricks 0.0.6
New features and
improvements
- Fix naming convention in
upload_directory_cnt.DatabricksVolume #84
- Added
Connecting to cluster, please wait.. as a
zephyr::msg_info prior to initialization of table and volume
connection
- Set dependency
brickster (>= 0.2.7)
- Add github templates for issues, features and PRs
- Updated
volume_methods to use zephyr::msg_info(),
replacing cli::cli_alert()
- Updated
volume_methods, table_utils and
table_methods to use zephyr::get_option() replacing a
bool
- Updated tests to use zephyr-option, with verbosity = quiet
- Fix bug regarding empty tables #73
- Fix tmp volume bug #63
- Add
upload_directory_cnt() and
download_directory_cnt() methods for
ConnectorDatabricksVolume class. Solves #77
- Update
remove_directory_cnt() method for
ConnectorDatabricksVolume class, now iterates over
directories and erases all the subdirectories and files. Solves #78
- Update
connector dependency to 0.1.0
official CRAN version.
connector.databricks 0.0.5
New features and
improvements
- Update
write_cnt() to use temporary volume solution, in
order to allow upload of bigger files.
- Update
list_content_cnt() to use tags when listing
tables in Databricks.
- Update
read_cnt() to allow users to search tables using
either timepoint or version parameter.
- Remove
DatabricksClient() and replace table and volume
methods with brickster methods.
connector.databricks 0.0.4
- Minor tweaks to the DESCRIPTION file. Removed references to
‘external’ non-CRAN GitHub packages.
connector.databricks 0.0.3
Breaking Changes
- Major renaming:
connector_databricks_dbi is now
ConnectorDatabricksTable. This affects several methods and
functions throughout the package.
- A wrapper function has been added for better consistency with other
connector packages
connector_databricks_table
- The dependency on
connector has been updated to use
0.0.8
New Features and
Improvements
- Refactored API for better consistency with the
connector package.
- Updated methods for
list_content_cnt,
log_read_connector, log_write_connector, and
log_remove_connector to use the new structure.
Documentation Changes
- Comprehensive update of documentation to reflect naming and
structure changes.
- Revised examples in the README to use the new nomenclature.
Internal Changes
- Renamed
volume_api.R file to
volumes_api.R.
- Updated _pkgdown.yml file to reflect the new package structure.
connector.databricks 0.0.1
- Initial release to internal package manager