The Apache Software Foundation/streampipes: Release release/0.93.0

Name: streampipes

Owner: The Apache Software Foundation

Release: 0.93.0

Released: 2023-11-20

License: Apache-2.0

Release Assets:

[0.93.0]

What's Changed

Enhancement 🌟

  • [#2092]: Remove magic HTTP numbers in StreamPipes
  • [#2056]: Make email templates configurable
  • [#2032]: Provide endpoint to get measurement counts from core
  • [#2031]: style: Add last message info to adapter overview
  • [#1992]: Migration of Kafka source configuration.
  • [#1980]: Arrays are not supported for S7 PLCs
  • [#1906]: Revive streampipes-maven-plugin to auto-generate pipeline element documentation
  • [#1875]: Connect: Order measurement units by name
  • [#1814]: Integrate extensions service discovery & configuration management into core
  • [#1716]: Enable creating CouchDB attachments for images
  • [#1688]: New Processor: Round Numeric Values
  • [#1662]: Support asynchronous browsing in OPC-UA adapter
  • [#1592]: Connect IO-Link Sensor Data into StreamPipes
  • [#1374]: Convenient columns query parameter for data lake measure
  • [#1103]: Support Python 3.11 in python client

Bug fixes 🧰

  • [#2191]: fix: tooltip in asset overview
  • [#2146]: fix(#2002) Retry service registration in case services are removed be…
  • [#2166]: Protected names are not sanitized correctly in Data Lake Sink / Influx sink
  • [#2165]: Update 0.92.0 -> 0.93.0 of Machine Data Simulator not working
  • [#2112]: Changes on messaging layer configuration on UI not persisted.
  • [#2044]: Docker compose build error
  • [#2024]: fix: make data retrieval of IOLink sensor more robust
  • [#1992]: Migration of Kafka source configuration.
  • [#1983]: Logo image broken in Footer
  • [#1956]: NPE in ConsulConfigMigration
  • [#1938]: Datetime selector in Data Explorer has issues with 12 am
  • [#1934]: Improve adapter started dialog in StreamPipes connect
  • [#1876]: Connect: Form validation in schema editor
  • [#1834]: [hotfix] Fix MDC layout issue in permission dialog
  • [#1829]: [hotfix] Fix layout issues and validation in data explorer
  • [#1794]: Aggregation field in data explorer widget is broken
  • [#1770]: Wrong base image in Maven archetypes
  • [#1769]: The dashboard fails to load the element whose name contiains '/'
  • [#1741]: The status light widget in the live dashboard is broken
  • [#1713]: OPC UA NullPointer Exception when Node Description is Missing
  • [#1642]: Data Lake default export period does not work
  • [#1637]: Schema guessing from file is currently not implemented in HTTP Server source
  • [#1629]: fix: kafka consumer data loss promble
  • [#1597]: apachestreampipes/sources-vehicle-simulator: 0.92.0-SNAPSHOT not found
  • [#1546]: Failed to upgrade the helm chart
  • [#1533]: Notification counter is not reset
  • [#1481]: URL Dereferencing Processor NotSerializableException

Breaking Change 💣

  • [#2143]: refactor(#2128): deprecate legacy adapters
  • [#2088]: Remove module streampipes-logging
  • [#2066]: refactor: remove legacy demo resources
  • [#1912]: Remove python wrapper
  • [#1583]: Remove CumSum Pipeline Element
  • [#1289]: Harmonize data set and data stream API

Deprecation ⚠️

  • [#2143]: refactor(#2128): deprecate legacy adapters
  • [#1640]: feature: retrieve credentials from SP environment variables

Documentation & Website 📚

  • [#2143]: refactor(#2128): deprecate legacy adapters
  • [#2138]: Use os.environ dictionary to set environment variables.
  • [#2069]: refactor: Add individual connector modules for adapters and sinks
  • [#2067]: Check references for watertank simulator and vehicle simulator on the website
  • [#2066]: refactor: remove legacy demo resources
  • [#1983]: Logo image broken in Footer
  • [#1978]: Add deployment of Prometheus and Grafana to K8s
  • [#1955]: Introduce Quickstart deployment mode
  • [#1945]: Add configuration hint for Kafka users.
  • [#1912]: Remove python wrapper
  • [#1906]: Revive streampipes-maven-plugin to auto-generate pipeline element documentation
  • [#1844]: chore: add Poetry badge to our README
  • [#1820]: Add Pulsar's Messaging Layer to a Helm Deployment
  • [#1817]: chore: introduce poetry as dependency management tool
  • [#1733]: feature: introduce admonitions to warn about dependency issue in docs
  • [#1694]: chore: improve metadata for repository
  • [#1640]: feature: retrieve credentials from SP environment variables

Dependency Updates 📦

  • [#2177]: deps: update Active MQ due to CVE
  • [#2140]: chore(deps-dev): bump eslint from 8.37.0 to 8.53.0 in /ui
  • [#2127]: chore(deps-dev): bump @angular-eslint/eslint-plugin-template from 15.2.1 to 16.2.0 in /ui
  • [#2126]: chore(deps): bump org.mockito:mockito-core from 5.6.0 to 5.7.0
  • [#2125]: chore(deps): remove org.wildfly.common:wildfly-common
  • [#2119]: chore(deps): bump com.google.protobuf:protobuf-java from 3.24.0 to 3.25.0
  • [#2113]: chore(deps-dev): bump webpack from 5.88.2 to 5.89.0 in /ui
  • [#2091]: chore(deps-dev): bump browserify-sign from 4.2.1 to 4.2.2 in /ui
  • [#2087]: chore(deps): bump com.rabbitmq:amqp-client from 5.19.0 to 5.20.0
  • [#2085]: chore(deps-dev): bump jasmine-core from 4.6.0 to 5.1.1 in /ui
  • [#2069]: refactor: Add individual connector modules for adapters and sinks
  • [#2066]: refactor: remove legacy demo resources
  • [#2048]: chore(deps-dev): bump assert from 2.0.0 to 2.1.0 in /ui
  • [#2038]: chore(deps-dev): bump @babel/traverse from 7.22.5 to 7.23.2 in /ui
  • [#2036]: chore(deps): bump plotly.js from 2.22.0 to 2.26.2 in /ui
  • [#2035]: chore(deps): bump org.apache.inlong:tubemq-client from 1.7.0 to 1.9.0
  • [#2027]: chore(deps-dev): bump @types/jasmine from 4.3.1 to 5.1.0 in /ui
  • [#2019]: chore(deps): bump shepherd.js from 11.1.1 to 11.2.0 in /ui
  • [#2015]: chore(deps): remove org.immutables
  • [#2011]: chore(deps): bump org.simplejavamail:simple-java-mail from 8.2.0 to 8.3.1
  • [#2009]: chore(deps-dev): bump webpack from 5.76.1 to 5.88.2 in /ui
  • [#1999]: chore(deps): bump io.nats:jnats from 2.16.1 to 2.17.0
  • [#1996]: chore(deps): bump org.checkerframework:checker-qual from 3.38.0 to 3.39.0
  • [#1988]: chore(deps): bump org.simplejavamail:simple-java-mail from 8.1.3 to 8.2.0
  • [#1984]: chore(deps): bump org.yaml:snakeyaml from 2.1 to 2.2
  • [#1977]: chore(deps): bump com.rabbitmq:amqp-client from 5.18.0 to 5.19.0
  • [#1972]: chore(deps-dev): bump org.testcontainers:testcontainers from 1.18.3 to 1.19.0
  • [#1970]: Bump org.mockito:mockito-core from 5.4.0 to 5.5.0
  • [#1964]: Bump org.xerial.snappy:snappy-java from 1.1.10.1 to 1.1.10.4
  • [#1963]: Bump tslib from 2.5.0 to 2.6.2 in /ui
  • [#1962]: Bump com.google.guava:guava from 32.0.1-jre to 32.1.2-jre
  • [#1949]: Bump com.nimbusds:nimbus-jose-jwt from 9.31 to 9.35
  • [#1946]: Bump typing-extensions from 4.5.0 to 4.8.0 in /streampipes-client-python
  • [#1942]: Bump org.boofcv:boofcv-core from 0.44 to 1.1.0
  • [#1939]: refactor: replace random password generation logic
  • [#1931]: Bump org.eclipse.jetty:jetty-http from 10.0.14 to 10.0.16
  • [#1930]: Bump org.eclipse.jetty:jetty-servlets from 10.0.14 to 10.0.16
  • [#1919]: Bump karma-jasmine-html-reporter from 2.0.0 to 2.1.0 in /ui
  • [#1916]: Bump net.minidev:json-smart from 2.4.9 to 2.5.0
  • [#1912]: Remove python wrapper
  • [#1881]: Bump cz.habarta.typescript-generator: typescript-generator-maven-plugin from 3.1.1185 to 3.2.1263
  • [#1861]: Bump roaster.version from 2.28.0.Final to 2.29.0.Final
  • [#1860]: Bump @ctrl/ngx-codemirror from 5.1.1 to 6.1.0 in /ui
  • [#1850]: Bump org.antlr:antlr4-runtime from 4.11.1 to 4.13.0
  • [#1848]: Bump @angular-eslint/builder from 15.2.1 to 16.1.1 in /ui
  • [#1837]: Bump redis.clients:jedis from 4.3.1 to 4.4.3
  • [#1836]: Bump lint-staged from 13.2.0 to 14.0.0 in /ui
  • [#1831]: Bump blacken-docs from 1.15.0 to 1.16.0 in /streampipes-client-python
  • [#1830]: Bump org.jetbrains.kotlin:kotlin-stdlib from 1.8.0 to 1.9.0
  • [#1825]: Bump com.google.protobuf:protobuf-java from 3.21.12 to 3.24.0
  • [#1821]: Bump org.boofcv:boofcv-core from 0.43.1 to 0.44
  • [#1817]: chore: introduce poetry as dependency management tool
  • [#1816]: Bump eslint-config-prettier from 8.8.0 to 9.0.0 in /ui
  • [#1812]: Bump konva from 8.4.0 to 9.2.0 in /ui
  • [#1810]: Bump @types/node from 18.14.0 to 20.4.6 in /ui
  • [#1805]: Bump pyupgrade from 3.9.0 to 3.10.1 in /streampipes-client-python
  • [#1804]: Bump flake8 from 6.0.0 to 6.1.0 in /streampipes-client-python
  • [#1802]: Bump org.boofcv:boofcv-core from 0.42 to 0.43.1
  • [#1801]: Bump mkdocs from 1.4.2 to 1.5.1 in /streampipes-client-python
  • [#1790]: Bump @jsplumb/browser-ui from 6.1.1 to 6.2.10 in /ui
  • [#1789]: Bump com.opencsv:opencsv from 5.7.1 to 5.8
  • [#1784]: Bump @typescript-eslint/parser from 5.59.11 to 5.62.0 in /ui
  • [#1780]: Bump word-wrap from 1.2.3 to 1.2.4 in /ui
  • [#1767]: remove dependency scala-xml_2.11
  • [#1766]: Bump semver from 5.7.1 to 5.7.2 in /ui
  • [#1765]: Bump checkstyle from 10.6.0 to 10.12.1
  • [#1764]: Bump black from 23.3.0 to 23.7.0 in /streampipes-client-python
  • [#1763]: Bump pyupgrade from 3.8.0 to 3.9.0 in /streampipes-client-python
  • [#1761]: Bump cypress from 12.8.1 to 12.17.0 in /ui
  • [#1759]: Bump amqp-client from 5.17.0 to 5.18.0
  • [#1749]: Bump blacken-docs from 1.14.0 to 1.15.0 in /streampipes-client-python
  • [#1748]: Bump extra-enforcer-rules from 1.6.1 to 1.7.0
  • [#1746]: Bump jquery from 3.6.3 to 3.7.0 in /ui
  • [#1739]: Bump graalvm.js.version from 22.3.1 to 23.0.0
  • [#1735]: Bump jakarta.activation-api from 1.2.2 to 2.1.2
  • [#1734]: Bump shepherd.js from 11.0.1 to 11.1.1 in /ui
  • [#1733]: feature: introduce admonitions to warn about dependency issue in docs
  • [#1730]: Bump javassist from 3.25.0-GA to 3.29.2-GA
  • [#1728]: Bump pyupgrade from 3.7.0 to 3.8.0 in /streampipes-client-python
  • [#1723]: Bump jboss-logging from 3.4.0.Final to 3.5.2.Final
  • [#1721]: Bump tubemq-client from 1.6.0 to 1.7.0
  • [#1715]: Bump okio from 1.16.0 to 3.3.0
  • [#1712]: Bump autoflake from 2.1.0 to 2.2.0 in /streampipes-client-python
  • [#1711]: Bump pytest from 7.3.0 to 7.4.0 in /streampipes-client-python
  • [#1710]: Bump formatter-maven-plugin from 2.21.0 to 2.23.0
  • [#1707]: Bump mypy from 1.3.0 to 1.4.0 in /streampipes-client-python
  • [#1704]: Bump spring-security-core from 6.0.3 to 6.1.1 & spring to 6.0.10
  • [#1702]: Bump angular-plotly.js from 4.0.4 to 5.0.0 in /ui
  • [#1699]: Bump @typescript-eslint/parser from 5.56.0 to 5.59.11 in /ui
  • [#1698]: Bump mockito-core from 5.3.1 to 5.4.0
  • [#1697]: Bump pyupgrade from 3.6.0 to 3.7.0 in /streampipes-client-python
  • [#1692]: Bump dependency-check-maven from 6.5.1 to 8.3.1
  • [#1689]: Bump snappy-java from 1.1.7.7 to 1.1.10.1
  • [#1687]: Bump guava from 31.1-jre to 32.0.1-jre
  • [#1686]: Bump @swimlane/ngx-charts from 20.1.2 to 20.4.1 in /ui
  • [#1681]: Bump testcontainers from 1.17.4 to 1.18.3
  • [#1679]: Bump nimbus-jose-jwt from 9.30.1 to 9.31
  • [#1678]: Bump blacken-docs from 1.13.0 to 1.14.0 in /streampipes-client-python
  • [#1674]: Bump pyupgrade from 3.4.0 to 3.6.0 in /streampipes-client-python
  • [#1640]: feature: retrieve credentials from SP environment variables
  • [#1636]: Bump mockito-core from 4.11.0 to 5.3.1
  • [#1631]: Bump mkdocstrings[python] from 0.21.1 to 0.22.0 in /streampipes-client-python
  • [#1595]: Bump spring-boot.version from 3.0.6 to 3.1.0
  • [#1591]: Bump pytest-cov from 4.0.0 to 4.1.0 in /streampipes-client-python
  • [#1588]: Bump types-requests from 2.30.0.0 to 2.31.0.0 in /streampipes-client-python
  • [#1587]: Bump socket.io-parser from 4.2.1 to 4.2.3 in /ui
  • [#1578]: Bump postgresql from 42.4.3 to 42.6.0
  • [#1576]: Support pulsar messasging layer
  • [#1335]: Replace @angular/flex-layout dependency with @ngbracket/ngx-layout dependency

Uncategorized ❓

  • [#2209]: build: change outputHashing in Angular to avoid caching issue after new release
  • [#2190]: ui: add link to LinkedIn in Support section
  • [#2135]: Max health check intervals configurable
  • [#2130]: Add E2E-Test for pipeline export and import
  • [#2129]: feat: Use alpine-based Docker image for UI
  • [#2122]: Cleanup extension bundles
  • [#2104]: Improve lifecycle for managing core and extension initialization actions
  • [#2098]: Implement first migration for S7 adapter
  • [#2076]: improve archetypes for adapter tutorial
  • [#2071]: refactor: minor adaption & improvement
  • [#2068]: refactor: Make interactive tutorial work again
  • [#2064]: refactor: introduce convenience method for service url
  • [#2061]: Create zip file during build phase with installer files only
  • [#2041]: refactor: remove references and artifacts for data sets
  • [#2018]: test(#2017): Add cypress test for configuration
  • [#2017]: Add more e2e tests to configuration view
  • [#2002]: Harmonize registration of adapters and pipeline elements
  • [#1926]: Improve handling of secrets in K8s
  • [#1852]: Remove sources-vehicle-simulator from cli-installer full env.
  • [#1843]: chore: refine dependency constraints
  • [#1787]: Improve logging of extensions services
  • [#1786]: add probes to Streampipes' kubernetes deployment ( #1781 )
  • [#1777]: Add API endpoint to get available users
  • [#1771]: Remove dependencies to specific protocols from the StreamPipes core service
  • [#1726]: Update Maven archetypes
  • [#1717]: Support other protocols besides Kafka in Streampipes Client for gathering live data
  • [#1683]: Support migration of adapters in data import
  • [#1682]: Harmonize OPC-UA adapter and sink, add timestamp to metadata (#899)
  • [#1676]: About Kafka consumer data loss problem
  • [#1673]: Make ChangedValueDetectionProcessor dimension sensitive
  • [#1664]: Unify the labels for OPC UA adapter & sink
  • [#1660]: Improve CSS assets to ease configuration of custom layouts
  • [#1651]: Integrate all experimental Flink pipeline elements into a single module
  • [#1648]: Move OPC-UA processor and sink into a single module
  • [#1632]: Cleanup API to define data processors and sinks
  • [#1628]: chore: add missing support of NATS as messaging protocol
  • [#1616]: Modify .asf.yaml to better organize Github discussions on mailing list
  • [#1590]: Rename the interface AdapterInterface to IAdapter in the remove-set-adapter branch
  • [#1589]: add sample configuration of pulsar subscription-name
  • [#1581]: HTTP Stream Adapter Stops Emitting Events When Running Multiple Instances
  • [#1580]: Include Set Adapters in CouchDB Backup During Migration Script
  • [#1260]: StreamPipes functions Python: required_streams vs consumed_streams

To top