Full Changelog: v8.2.0...v8.3.0, see Milestone 8.3.0 for more info.

Notice

• WebServiceListeners now use a different way of returning Multipart Attachments. The old behavior can be restored by setting 'WebServiceListener.backwardsCompatibleMultipartNotation=true'.
• Changed default log level from DEBUG to INFO, for environments that are not configured with dtap.stage at value: ACC or PRD. These are by default on WARN level.
• Packages names have been changed, though you should not need to change your configurations, it's advised to do it ASAP.
• We are now publishing our artifacts under our new org.frankframework groupid on Maven Central.
• FixedQuerySender allows duplicate parameter names ONLY if useNamedParams is explicitly set to false.
• CompressPipe pattern attributes have been deprecated, please use the appropriate parameters and resolve the pattern in there instead. The result has now also by default been changed to the file/zip-entry instead of a file location.
• The servlets IAF-API and console has been merged into 1 entity, configured properties need to be configured differently.
  • servlet.IAF-API.authenticator and/or servlet.IAF-API.authenticator has turned into application.security.console.authentication.type.
  • There is no longer a need to configure an authenticator directly, properties can be set directly on application.security.console.authentication.<property-name>.
• The Frank!Console can be run standalone and automagically find 'worker' nodes. The ideal setup is K8s in combination with Hazelcast. More information can be found in our Helm chart.

Highlights

Bugfixes
Many Performance enhancements
Code Quality improvements
Cleanup lots of Technical Debt
All the Security Updates
Minimal JDK 17 + JDK21 runtime support
Improved documentation

What's Changed

• Fix AWS bucketName prefix when creating files (Fix bucketName prefix when creating files #7182)
• Add an in-mem to disk overflowing outputstream buffer (Add an in-mem to disk overflowing outputstream buffer #7171)
• Speed up startup and shutdown of configurations (Speed up startup and shutdown of configurations #7197)
• No redelivery-delay when final max retry count reached (No redelivery-delay when final max retry count reached #7199)
• Log Mime Multipart exception in ApiListenerServlet (Log Mime Multipart exception in ApiListenerServlet #7205)
• Add FrankSender as alternative for IbisLocalSender and IbisJavaSender (Add FrankSender as alternative for IbisLocalSender and IbisJavaSender #7187)
• Fix CsvParserPipe spaces in header (Fix CsvParserPipe spaces in header #7232)
• Implement custom properties for Tibco classes (Implement custom properties for Tibco classes #7237)
• Split health checks so each endpoint only target it's own scope (Split health checks so each endpoint only target it's own scope #7253)
• Add local users yaml authenticator (Add local users yaml authenticator #7261)
• Add FrankListener for use with FrankSender (Add FrankListener for use with FrankSender #7227)
• Show a console warning when the XmlValidator pipe is in an incorrect state (Show a console warning when the XmlValidator pipe is in an incorrect state. #7284)
• Tibco age field may not be negative (Tibco age field may not be negative (#7263) #7302)
• Fix Json2XmlInputValidator with multiple optional elements (Fix Json2XmlInputValidator with multiple optional elements #7271) (Fix Json2XmlInputValidator with multiple optional elements (#7271) #7307)
• Format a DateParam using the formatString when converting a Date object back to a String (Format a DateParam using the formatString when converting a Date object back to a String. #7286)
• Download all active configurations (Download all active configurations #7334)
• Fix JavaScriptSender configure exceptions (Fix JavaScriptSender configure exceptions #7336)
• Disable re-compilation of JSP scripts, fixes a potential security risk (Disable re-compilation of JSP scripts, because this is a security risk. #7322)
• Fix NPE in getPhysicalDestinationName on Jdbc elements (Fix NPE in getPhysicalDestinationName on Jdbc elements #7357)
• Allow local-file path to be used when looking up resources (Allow local-file path to be used when looking up resources #7349)
• Add statistics for receiving messages (Add statistics for receiving messages #7364)
• Fix potential invalid element names in SaxElementBuilder (Fix invalid element name in SaxElementBuilder #7369)
• Use more configurable Frank!Element lifecycles (Use more configurable lifecycles #7365)
• Add metrics for JmsSender sessions (Add metrics for JmsSender createSession #7370)
• Make console-backend able to filter target node (Make console-backend able to filter target node #7391)
• Implement micrometer on webservices (Implement micrometer on webservices #7396)
• Subscribe to websocket channels based on selected cluster member (Subscribe to websocket channels based on selected cluster member #7411)
• Introduce DataSonnetPipe to allow JSON translations (Introduce DataSonnetPipe to allow JSON translations #7439)
• Fix error message on Rerun from Tibet2 exception log (Fix error message on Rerun from Tibet2 exception log #7452)
• Fix/add DirectoryListener documentation (Add an example to the DirectoryListener and fix an incorrect reference. #7272)
• Fix NPE in IDinConfig (Fix NPE in IDinConfig #7468)
• Add documentation to scheduled jobs (Add documentation to scheduled jobs #7469 + Update job descriptions, use ff.info tags #7485)
• Fix mermaid xsl issues for config and adapter (fix mermaid xsl issues for config and adapter #7471)
• Merge CheckSumPipe and HashPipe and add hashEncoding (Merge CheckSumPipe and HashPipe and add hashEncoding #7456)
• Remove log4j2.properties file (Remove log4j2.properties file #7496)
• Add option to Pipeline to validate if session-keys are available (Add option to Pipeline to validate if session-keys are available #7465)
• Support rowversion as binary timestamp for mssql (Support rowversion as binary timestamp for mssql #7498)
• Use CID in test pipeline when present (Use CID in test pipeline when present #7535)
• Fix URL mapping on wildcard endpoints (Fix URL mapping on wildcard endpoints #7532)
• Remove authentication header in case of request parameter authentication type (Remove authentication header in case of request parameter authentication type #7505)
• Fixes and unit tests for JMS ackmode=client (Fixes and unit tests for JMS ackmode=client #7554)
• Remove tibcrypt library (Remove tibcrypt library #7560)
• Throw exception when using invalid forward name (Throw exception when using invalid forward name #7562)
• Fix null configuration warnings update not being picked up (Fix null configuration warnings update not being picked up #7572)
• Validate pipe forwards during configure phase (Validate pipe forwards during configure phase #7579)
• Fix minimum page height & hide scrollbars on testing & custom views (Fix minimum page height & hide scrollbars on testing & custom views #7586)
• Resolve output validator correctly (Resolve output validator correctly #7568)
• Update FileSystemActor documentation for outputtype (FileSystemActor - update javadoc for outputtype #7601)
• Implement multi method uri mapping and test (Implement multi method uri mapping and test #7597)
• Set Message MimeType when known and add computeMimeType to DataSonnetPipe (Set Message MimeType when known and add computeMimeType to DataSonnetPipe #7608)
• Fix sap idoc flow (Fix sap idoc flow (#7589) #7611)
• Trim header and value in ApiListener headers (Trim header and value in ApiListener headers #7613)
• Receiver should always process message in existing transaction (Receiver should always process message in existing transaction #7598)
• Add SEALED authenticator and use it by default (Add SEALED authenticator and use it by default #7627)
• Secure all but the healthcheck (/iaf/api) endpoints (Secure all but the healthcheck (/iaf/api) endpoints #7632)
• Make sure larva tool can use valuefile params like it should (Make sure larva tool can use valuefile params like it should #7635)
• Some code cleanups in XSD and related classes (Some code cleanups in XSD and related classes #7653)

Frank!Console

• Fix console message store endpoints (Fix console message store endpoints #7151)
• Ability to dynamically add new loggers with specific log levels on the log settings page (Ability to dynamically add new loggers with specific log levels on the log settings page #7434)
• Modify console backend JSON for new metrics (Modify console backend JSON for new metrics #7415)
• Integrate the Monaco Editor in the Frank!Console (Integrate the Monaco Editor on more pages #7331)
• Fix message browser selected messages with non-numbers (Fix message browser selected messages with non-numbers #7166)
• Add Websocket events for warning & adapter updates (Add Websocket events for warning & adapter updates #7144)
• Fix incorrect adapter status colour & improved adapter updates (Fix incorrect adapter status colour & improved adapter updates #7533)
• Fix JMS form issues (Fix JMS form issues #7539)
• Fix WebSocket fallback with SockJS (Fix WebSocket fallback with SockJS #7454)
• Replace jQuery dependencies with custom components/solutions (Replace jQuery dependencies with custom components/solutions #7506)
• Update CSP header policy directives (Update CSP header policy directives #7647)
• Cleanup WSS and Show on Test-ServiceListener console page (Cleanup WSS and Show on Test-ServiceListener console page #7643)
• Show warning popup alert when websocket & fallback don't work (Show warning popup alert when websocket & fallback don't work #7660)

Ladybug

• Use ladybug.abortpoint with message (Use ladybug.abortpoint with message #7398)
• Only pass an errorMessage if the http status code is an error (Only pass an errorMessage if the http status code is an error #7480)
• Prevent CloseReportsTask from throwing NPEs (Prevent CloseReportsTask from throwing NPEs #7490)
• Add config name to testtool reports (Add config name to testtool reports #7534)
• Create new ladybug module for ff console (Create new ladybug module for ff console #7495)
• Cleanup ladybug modules and use SecurityChain instead of WebSecurity (Cleanup ladybug modules and use SecurityChain instead of WebSecurity #7540)
• Don't show exit state in ladybug when it's 0 (Don't show exit state in ladybug when it's 0 #7550)
• Create ladybug common module (Create ladybug common module #7556)
• Split ladybug debugger code (Split ladybug debugger code #7569)
• Cleanup ladybug XMLs and use spring profiles for storage (Cleanup ladybug XMLs and use spring profiles for storage #7578)
• Fix AOP config in configuration (Fix AOP config in configuration #7584)
• Add option to use custom resources.yml file for the ladybug (Add option to use custom resources.yml file for the ladybug #7654)
• Fix ladybug Rerun Roles (Fix ladybug Rerun Roles #7631)
• Allow null-message to be rerun in the ladybug (Allow null-message to be rerun in the ladybug #7661)
• Fix NPE when Ladybug rerun cannot find config (Fix NPE when Ladybug rerun cannot find config #7667)

Non backwards compatible changes

• Transaction Manager BTM is removed. Switch over to Narayana Transaction Manager.
• Only supports Tomcat 10.x or later. Tomcat 9.x or lower version, are no longer supported.
• FileSystemPipes and FileSystemSenders now have new forwards for fileNotFound, folderNotFound, fileAlreadyExists, folderAlreadyExists. Some actions, such as removing a non-existing folder, were previously ignored but can now trigger one of these forwards. If such a forward is not defined, then the pipe or sender will go to the exception forward or if that is not defined either, trigger an exception, which was previously ignored. Adding the specific exception forward and pointing it to the next pipe will solve this.
• The MoveFilePipe was deprecated for a while and has been removed now. Please use the LocalFileSystemPipe if you need to move a file.
• In the FixedResultPipe, the deprecated setUseOldSubstitutionStartDelimiter has been removed. This enforced using the ${..} syntax, but now only the ?{..} is supported.
• WebServiceListeners now use a different way of returning Multipart Attachments. The old behavior can be restored by setting 'WebServiceListener.backwardsCompatibleMultipartNotation=true'.
• The messageType attribute of IMapListener, ExchangeMailListener, DirectoryListener, FtpFileSystemListener, FtpsFileSystemListener, SambaListener and Samba2Listener is an enum and no longer supports a custom value to search for attributes in the file. This can be achieved by using the INFO messageType with a xpath expression.
• The HttpListener endpoint has been disabled by default.