Skip to main content

Biweekly Updates

This page summarizes changes for Timeplus Enterprise and Timeplus Proton, on a biweekly basis, including new features and important bug fixes.

Nov 11, 2024

Timeplus Proton v1.6.2

  • Added a new EMIT policy in streaming SQL with global aggregation. The new EMIT PERIODIC .. REPEAT syntax will show the last aggregation result even there is no new event.
  • Fixed a bug that views with incorrect syntax could be created.

Timeplus Grafana plugin v2.0.0

  • The new release of Timeplus Grafana Plugin v2.0, available now on our GitHub repository. This latest version introduces significant improvements in both performance and stability. Whether you’re using Timeplus Enterprise or the open-source Timeplus Proton, this plugin allows you to seamlessly monitor real-time data through Grafana, utilizing both simple and complex analytics to track live data trends.

Documentation Updates

  • Updated the guide of Ingest REST API to add more instructions for self-hosting Timeplus Enterprise. API keys are only available in Timeplus Cloud. For self-hosting deployment, please encode the username and password with base64, and set it in the HTTP Authorization header.
  • Updated the structure of Kafka external stream. Mentioned RawBLOB as a supported data format.
  • Added documentation for materialized view load balancing.

Oct 28, 2024

Timeplus Proton v1.6.1

  • Fixed the issue that SHOW CREATE STREAM doesn't work. Since this version, you can run either SHOW CREATE stream_name or SHOW CREATE STREAM stream_name.
  • Refined the display of datetime value in proton client. Same behavior as before, if the timezone is not specified. For datetime('UTC'), "Z" will be shown at the end. For other timezones, such as datetime('Europe/London'), the full timezone offset will be shown, such as "2024-09-10 18:21:46+01:00".

Timeplus Python Driver v0.2.11

Sling v1.2.21 and v1.2.22

Sling is a CLI tool that extracts data from a source storage/database and loads it in a target storage/database. You can use sling to export data from one Timeplus deployment and import to the other Timeplus deployment. In these 2 releases, we contributed a few new features and enhancements:

  • Added new SLING_DIRECT_INSERT environment variable to enable direct data inserts from source Timeplus to the target Timeplus, bypassing a temporary table.
  • By default, the exported CSV files use " to quote the value. Now this can be customized to any value, such as $a,b$, instead of "a,b".

Documentation Updates

  • The top navigation bar is updated to provide quick accesses to the major steps to use Timeplus.
  • Refined Insert Idempotency page to highlight x-timeplus-idempotent-id is available in Ingest REST API. Also explained the max_idempotent_ids setting.
  • Added documentations for function format_readable_quantity and format_readable_size.

Oct 14, 2024

Timeplus Web Console v2.0.3

We upgraded the timeplus_web component in https://demo.timeplus.cloud. This will be rolled out to https://us-west-2.timeplus.cloud soon. Compared to the previous version (v2.0.1), the key enhancements are:

  • Redesigned the "Data Collection" and "Sink" page to support hundreds of input/output connectors, powered by Redpanda Connect. Timeplus Enterprise provides intuitive configuration wizards for NATS, WebSocket and HTTP Stream. For other data sources or destinations, you can also configure via a YAML file. Stay tuned for more product announcements and showcases.
  • Reordered the items on resource side panel.
  • Improved the error handling on SQL Console page and upload CSV page.

Testcontainers for Java v1.20.2

The new version of Testcontainers for Java supports the Timeplus module. You can automate the stream processing with Timeplus and Kafka containers in your JUnit test code. Check the tutorial for details.

Documentation Updates

Sep 30, 2024

Timeplus Cloud has a new home. Our previous domain, https://us.timeplus.cloud, has been redirected to https://us-west-2.timeplus.cloud. All workspaces have been migrated and no further action is needed. If you create a workspace via https://demo.timeplus.cloud, you will also be redirected to https://us-west-2.timeplus.cloud. The latest Timeplus Enterprise features are available in the new site. If you prefer using a different cloud region, please let us know.

Timeplus Web Console v2.0.1

We upgraded the timeplus_web component in https://us-west-2.timeplus.cloud. Compared to v1.4.33 in Timeplus Enterprise self-hosted edition, the key enhancements are:

  • You can now set a timezone in dashboards to display the datetime or timestamp in your preferred timezone.
  • See additional metrics in the details side panel for streams, materialized views, external streams, or other resources: events per second, status, throughput, and more.
  • Refinements to error and warning messages, including avoid showing two messages for the same resource.
  • Moved the 'Send as Sink' button to the 'Save As' dropdown in the SQL Console.
  • Able to render large numbers such as int256 or uint256.
  • Wizard UI to create Timeplus External Streams.
  • Wizard UI to create Mutable Streams.
  • Fix the issue where scrollbar is too thin.
  • In SQL Console, you can write multiple SQL statements and select one to run the statement.

Timeplus Rust Client v0.1.2

A maintenance release to include latest dependencies. No new features or bug fixes. Please get it via https://crates.io/crates/proton_client

Sep 16, 2024

The new cloud service available at https://us-west-2.timeplus.cloud. The previous cloud (https://us.timeplus.cloud) will be sunset. The new cloud service ships the latest Timeplus features, such as mutable streams.

Timeplus Proton v1.5.17 and v1.5.18

  • New feature: drop large streams via SETTINGS force_drop_big_stream=true. Learn more
  • New feature: support EXPLAIN SELECT .. as a sub-query
  • Fix the problem of multi-shard incorrect result on distinct
  • Improvement for telemetry service to exclude system level queries and make interval configurable
  • New feature: allow to set timeout for Remote UDF

Timeplus Destination Connector for Airbyte v0.1.20

Support us-west-2.timeplus.cloud as the default endpoint. Dependencies are updated. This is available for both Airbyte Cloud and Airbyte OSS.

Timeplus Native JDBC v2.0.5

Support JDK 8, per customer feedback.

Sep 2, 2024

Timeplus Enterprise v2.4.23

  • Timeplus Enterprise v2.4.23 is released as the latest stable build.
  • The key changes are:
    • (timeplusd) support for dropping partitions on cluster
    • (timeplusd) add additional query_type in sql analyzer
    • (timeplusd) enhanced historical asof joins, with a performance improvement of over 30%
    • (timeplus_web) use username:password for ingest API wizard

Timeplus C++ SDK

https://github.com/timeplus-io/timeplus-cpp is a public repo for integrating Timeplus with your C++ code.

You can run DDL, streaming queries, or data ingestion with this C++ client. Both sync and async inserts are supported, with idempotent_id support.

Metabase Driver v0.50.4

The v0.50.4 Metabase Proton Driver supports metabase 0.50.x.

However it is verified to work with Proton 1.5.6, not the latest version of Timeplus Proton (currently 1.5.16) or Timeplus Enterprise yet.

We are actively working on the refinement to support latest Timeplus core engine.

Aug 19, 2024

Timeplus Enterprise v2.4.18

Timeplus Proton v1.5.16

  • When you start with proton server, it will listen on 0.0.0.0 (instead of 127.0.0.1 in previous versions), so you can connect to Proton from any host. This is not recommended for production deployment but is useful when you start Proton in a container and what to access it from the host.
  • Fix an issue, you can run SELECT * FROM information_schema.tables
  • Support append-only LEFT ALL JOIN append-only.

Aug 6, 2024

Timeplus Enterprise v2.4.15

  • Timeplus Enterprise v2.4.15 is released. See full changelog
  • Improved error handling in the SQL Console: if errors occur when executing the query, runtime errors and intermediate query results are shown.
  • With the new mutable stream in Timeplus Enterprise, versioned stream and changelog stream are now deprecated. We now have two types of streams: append-only and mutable.
  • Stream “mode” is renamed to stream “type” in the web console UI.

Timeplus Proton v1.5.15

  • Timeplus Proton v1.5.15 is released, allowing Timeplus Enterprise v2.4 to read or write via external streams. Learn more

Timeplus Native JDBC v2.0.4

  • Bug fix: For low_cardinality(nullable), nullable(uuid), map(low_cardinality) and tuple(low_cardinality)
  • Bug fix: Fixed logging problem in some datatypes
  • Bug fix: For the map defaultValue()

Jul 22, 2024

Timeplus Enterprise

We are working on Timeplus Enterprise v2.4.x. The build is not ready to be published yet. Key changes:

  • When launching Timeplus Enterprise for the first time, a system dashboard will be created to show usage and workspace stats.
  • In the SQL Console, see a query's pipeline after running a query. Note: This is available for single-node on-prem deployments.
  • New external stream: AutoMQ. A configuration wizard is available in the console UI. Learn more
  • New stream mode: mutable streams, where values with the same primary key(s) will be overwritten. More advanced configuration options will be available soon.
  • In the Help side panel, see detailed version and build times for components.
  • A new "Get Started" section on the homepage for on-prem deployments, with links to a demo video, docs, and support.
  • Added additional metrics for materialized views.
  • Updated license UI for on-prem deployments.
  • Ably data source is now removed.

Timeplus Proton v1.5.14

  • Remote user-defined functions (UDFs) can now be created via SQL.
    • Example: CREATE REMOTE FUNCTION ip_lookup(ip string) RETURNS string URL 'https://abc.lambda-url.us-west-2.on.aws/'
  • Mutable streams performance tuning: added key_space_full_scan_threads setting.
  • Improved asof join performance.
  • Added support for primary key columns in secondary key.
  • (v1.5.13) Bugfix: When the format schema is dropped, the format schema cache is now properly cleared
  • (v1.5.13) Bugfix: A null pointer access before type cast

Timeplus Native JDBC v2.0.2

bigint and decimal types are now supported, and a bugfix for invalid version for low cardinality key.

Jul 8, 2024

Timeplus Enterprise v2.3.5

  • Different channels for stable builds and latest builds:
    • curl https://install.timeplus.com | sh downloads and installs the stable build (currently v2.3.0).
    • curl https://install.timeplus.com/latest | sh downloads and installs the latest build for you to try newest features and bug fixes (currently v2.3.5).
    • See our changelog for each stable/latest version.
  • New SQL Commands: SYSTEM PAUSE and SYSTEM UNPAUSE. If you want to pause a materialized view, run SYSTEM PAUSE MATERIALIZED VIEW mv. To unpause it, run SYSTEM UNPAUSE MATERIALIZED VIEW mv. We added this feature based on user feedback and to improve troubleshooting efficiency. Learn more

Timeplus Proton v1.5.12

Timeplus Native JDBC v2.0.1

A new JDBC driver for Timeplus is now available, supporting both streaming and batch queries. Compared to the JDBC driver we released last year, this new driver talks to Timeplus via the TCP native protocol, with better performance. Learn more

Jun 24, 2024

Timeplus Enterprise v2 is now available for cloud or self-hosted deployment. See installation options for self-hosting.

Timeplus Enterprise v2.3.0

Self-Hosted:

  • Account setup flow for self-hosted deployment: create account and login screens.
  • License management: In Workspace Settings, see your existing licenses and entitlements. Contact us to purchase a new license, then enter the license key and upload the license file in Workspace Settings.
  • Usage monitoring: Also in Workspace Settings, see your daily usage for ingested data and scanned external stream data.
  • Preview: Python User-Defined Functions (UDF). Create UDFs by leveraging Python libraries, such as pandas. Contact us to try this feature.

Timeplus Proton v1.5.11

  • When creating an external stream for Apache Kafka and running select count() from table(stream), Timeplus Proton will retrieve the number of messages in the Kafka topic. If you set data_format = "RawBLOB", one_message_per_row=false, Proton will use the Kafka offset to get the message count. But if one_message_per_row=true, then Proton will read each message to split the rows. It won’t retrieve the result as fast as calculating the offset, but it will be more accurate.
  • When using an external stream to write data to Kafka, a new setting kafka_max_message_size is now available. When the external stream is created with data_format='JSONEachRow',one_message_per_row=false, each message in Kafka may contain multiple rows, with each row being a JSON document. This new setting kafka_max_message_size will control how much data will be put in a Kafka message and when to create a new Kafka message, ensuring each message won't exceed the kafka_max_message_size limit.
  • New function: array_fold, which is equivalent to the Array.reduce function in JavaScript, and is used to fold or reduce the elements in an array from left to right by applying a lambda-function to the array elements in a cumulative manner.
  • array_max/min functions now support datetime.