v1.10.0

Ironclad/rivetv1.10.0Oct 16, 2023by abrenneke

AI Summary

This release focuses on improved bundling and node functionality. The major change switches from tiktoken to gpt-tokenizer, eliminating wasm dependencies and making rivet-node bundling easier. Several new node capabilities are added including a new Extract Markdown Code Blocks node, configurable inputs/outputs for the Code node, and regex support for the Split Text Node.

Key Highlights

Switched to gpt-tokenizer from tiktoken, removing wasm dependencies for easier bundling
Added new Extract Markdown Code Blocks node
Code node now supports configurable inputs and outputs
Split Text Node now supports regex splitting
Fixed Graph Output node output port not having a value

New Features

Switch to gpt-tokenizer instead of tiktoken (eliminates wasm, easier bundling; custom tokenizer can still be passed in)
Add Extract Markdown Code Blocks node
Code node now supports configurable inputs and outputs
Support escape characters in delimiter for Join Node and Split Text Node
Support for Split Text Node splitting by regex

Full Release Notes

## Features & Changes

- Switch to [gpt-tokenizer](https://github.com/niieani/gpt-tokenizer) instead of tiktoken, which means no more wasm being included, should make bundling `rivet-node` easier. Tokenizer can also be passed in if someone wants to use tiktoken again, as it's faster.
- Add Extract Markdown Code Blocks node
- Code node now supports configurable inputs and outputs
- Support escape characters in the delimiter for Join Node and Split Text Node
- Support for Split Text Node splitting by regex

## Bug Fixes

- Fix node warning about event emitter max listeners
- Fix output port of Graph Output node not having a value
- Fix `name` and `type` input ports of Prompt Node not working