Howler API 3.0.0

⚠️ BREAKING CHANGES - This release requires complete data reindexing. See migration guide for details.

• Schema Breaking Changes (breaking change): Introduction of new data types requiring complete Elasticsearch reindexing:
  • New odm.Long data type for handling large integer values with proper Elasticsearch long datatype mapping
  • Migrated source.bytes and destination.bytes fields from Integer to Long type
  • Migrated analytic and view titles/names to odm.CaseInsensitiveKeyword for improved search functionality
  • Migrated hit outline values from odm.Text to odm.Keyword for better indexing and querying performance
• Reindexing Script Improvements (new feature): Enhanced reindexing script with selective index reindexing,
  safety warnings, and improved user feedback
• Search API Explanation Endpoint (new feature): Added explanation endpoint to search API for better query
  debugging and optimization
• Namespace Management (new feature): Added add_namespace and remove_namespace functions with comprehensive unit
  tests for better index organization
• Basic Authentication Support (new feature): Added basic auth alternative for connecting to datastore as an
  option alongside existing authentication methods
• Index Mapping Output (new feature): Added index mapping output to reindex_data.py for better visibility into
  schema changes
• View Dashboard Cleanup (new feature): Added cron job for cleaning up references to deleted views from dashboards
• Dossier Validation (bugfix): Fixed dossier validation to handle edge cases and improve data integrity
• Lead Format Validation (bugfix): Removed enum validation from lead format for more flexible configuration
• Namespace Index Mappings (bugfix): Fixed add_namespace function as it relates to index mappings for proper
  schema handling
• Python 3.9 Support Removed (infrastructure update): Removed support for Python 3.9, now requires Python 3.10 or higher
• Filestore Configuration Cleanup (infrastructure update): Removed references to unused filestore configurations
  for cleaner codebase
• Docker Image Updates (infrastructure update): Updated image tags from cccsaurora/howler-api to cccs/howler-api,
  added nightly build tags
• Dockerfile Reorganization (infrastructure update): Moved Dockerfile from api/docker/Dockerfile to api/Dockerfile
  for simplified structure
• Poetry Migration (infrastructure update): Migrated from abatilo/actions-poetry to direct poetry installation for
  more reliable builds
• CI/CD Improvements (infrastructure update): Fixed API dependency build issues and improved workflow reliability
  with better git merge base handling
• Dependency Updates (infrastructure update): Updated urllib3 to v2.6.0, werkzeug to v3.1.4, authlib to v1.6.5 for
  security and stability
• Elasticsearch Shards Configuration (database & storage): Updated default shards configuration for better cluster
  performance

Howler UI 2.15.0

• Dossier Page URL State Persistence (new feature): Added URL parameter synchronization for dossier editor tabs
  and indices to maintain UI state across page refreshes and navigation
• Dossier Card Navigation Enhancements (UI/UX improvement): Enhanced dossier cards with clickable lead and pivot
  chips for direct navigation, and added "Open in Search" button for quick query execution
• View Link Enhancements (new feature): Added additional functionality to ViewLink component for improved
  navigation and interaction
• Previous Rationales Display (new feature): Added ability to view previous rationales in the rationale modal for
  better context
• Exclude By Function (new feature): Added "Exclude By" function to hit context menu for more flexible filtering options
• Improved Plugin Components (UI/UX improvement): Enhanced plugin chip component with mapping support for better
  data visualization
• View Filtering (bugfix): Fixed bug where null viewIds would trigger search errors
• User Profile Settings (bugfix): Fixed issue where user profile would immediately close when editing settings
• Custom Pivot Types (bugfix): Fixed adding custom pivot types to ensure proper functionality
• Dashboard Enhancements (UI/UX improvement): Optimizations and fixes for improved dashboard performance and stability
• Markdown Component Injection (bugfix): Fixed injection of markdown components to prevent security issues
• Markdown Retention (UI/UX improvement): Improved markdown retention across navigation and state changes
• Borealis to Clue Refactor (technical update): Completed refactoring from borealis to clue for improved maintainability
• Dependencies (technical update): Updated glob to v11.1.0, vite to v6.4.1, axios to v1.12.0
• Build System (technical update): Improved UI publishing workflow with better pnpm package handling and type checking
• Translation Updates (technical update): Added French translations for new features including dossier "Open in
  Search" functionality and starting markdown templates

Howler UI 2.14.0

Features:

• Contribution from Truesec, improving UI plugin capabilities in Howler: PR
  • Improved manipulation of the UI sidebar
  • Additional routes
  • Additional sitemap entries
• added ability to provide additional metadata to plugin components (to enable hardcoded types for clue enrichment) PR

Bugfixes:

• Fixed bug on view deletion when the view is favourited PR
• Stopped metadata from being rendered in hit details tab PR
• Fixed Analytic Comments bug when there's a space in the analytic name PR
• Fixed bug when rendering hardcoded leads PR
• Added fix to sort pinned views alphabetically PR
• Fixed bug in User Profile that would make it close when clicked, ever when this isn't wanted PR
• Fixed bug when selecting a view PR
• Fixed bug where users could add duplicate panels to the home dashboard PR

Documentation:

• Note: Much of the work here isn't yet live. A new howler-docs instance will be deployed in the coming weeks.
• Reworked markdown generation of documentation to enable new howler-docs version (not ready yet)
• Added improved documentation of the API codebase, including folder structure and summary modules
• Added improved plugin documentation for API and UI
• Added information for contributors on the patching process
• Updated information on backend development steps
• Migrated documentation from howler-docs repository

Miscellaneous

• Various version bumps
• Fixes to howler-ui package publishing
• Minor improvement in UI unit testing
• French/English localization of howler helpers
• Removal of various unused dependencies

Howler API 2.12.0

Bugfixes:

• Fixed bug on view deletion when the view is favourited PR
• Added cronjob to periodically remove stale references to deleted views from users' favourites PR
• Loosened validation on Pivot types to enable better plugin support of pivots PR

Documentation:

• Note: Much of the work here isn't yet live. A new howler-docs instance will be deployed in the coming weeks.
• (doc) Reworked markdown generation of documentation to enable new howler-docs version (not ready yet)
• (doc) Added improved documentation of the API codebase, including folder structure and summary modules
• (doc) Added improved plugin documentation for API and UI
• (doc) Added information for contributors on the patching process
• (doc) Updated information on backend development steps
• (doc) Migrated documentation from howler-docs repository

Miscellaneous

• Various version bumps across plugins, api
• Authlib 1.6.5 update

Howler UI 2.13.2

For high level changes, see here

What's Changed

• Fix augment metadata by @cccs-mdr in #68
• Fixing view selection by @cccs-mdr in #69

Full Changelog: v2.13.1-ui...v2.13.2-ui

Howler API 2.11.2

For high-level release notes, see here

What's Changed

• Fix augment metadata by @cccs-mdr in #68

Full Changelog: v2.11.1-api...v2.11.2-api

Howler UI 2.13.1

For high-level release notes, see here

Full Changelog: v2.13.0-ui...v2.13.1-ui

Howler API 2.11.1

For high-level release notes, see here

Full Changelog: v2.11.0-api...v2.11.1-api

Howler UI 2.13.0

For high-level release notes, see here

What's Changed

• Optimizing facet searching by @cccs-mdr in #43
• Add borealis plugin by @cccs-mdr in #41
• View Optimizations by @cccs-mdr in #42
• Fixed key count error by @cccs-mdr in #45
• Added height fix for multiline queries in Howler by @cccs-tsha in #47
• Updated pnpm.lock by @cccs-mdr in #48
• Bump axios from 1.10.0 to 1.11.0 in /ui by @dependabot[bot] in #46
• Hit Metadata Functionality by @cccs-mdr in #44
• Handling deprecation, removing unused code by @cccs-mdr in #49
• Fixed InformationPane to properly allow overview by @cccs-mdr in #51
• Bump urllib3 from 2.4.0 to 2.5.0 in /plugins/evidence by @dependabot[bot] in #54
• Howler fields mapping to borealis on UI by @cccs-tsha in #50
• Fixed view filtering by @cccs-mdr in #53
• Add optional parameter to Link model and refactor PivotLink and RelatedLink components by @cccs-mdr in #58
• Fixed view editing to allow changing of view type by @cccs-mdr in #52
• Fixed middle click analytic name in Hit Banner by @cccs-mdr in #55
• Added button to allow users to trigger howler actions in markdown by @cccs-mdr in #59
• Refactored/slimmed down analytic context by @cccs-mdr in #56
• Convert docker images to alpine by @cccs-mdr in #60
• Added clear query button by @cccs-tsha in #61
• Bump mermaid from 11.9.0 to 11.10.0 in /ui by @dependabot[bot] in #64
• Added documentation for Text vs Keyword in Howler by @cccs-tsha in #63
• Improved advanced search functionality by @cccs-mdr in #62
• Fixed JSON search to always show on information pane by @cccs-mdr in #65
• Convert moment to dayjs by @cccs-mdr in #66

Full Changelog: v2.10.0-api...v2.13.0-ui

Howler API 2.11.0

For high-level release notes, see here

What's Changed

• Optimizing facet searching by @cccs-mdr in #43
• Add borealis plugin by @cccs-mdr in #41
• View Optimizations by @cccs-mdr in #42
• Fixed key count error by @cccs-mdr in #45
• Added height fix for multiline queries in Howler by @cccs-tsha in #47
• Updated pnpm.lock by @cccs-mdr in #48
• Bump axios from 1.10.0 to 1.11.0 in /ui by @dependabot[bot] in #46
• Hit Metadata Functionality by @cccs-mdr in #44
• Handling deprecation, removing unused code by @cccs-mdr in #49
• Fixed InformationPane to properly allow overview by @cccs-mdr in #51
• Bump urllib3 from 2.4.0 to 2.5.0 in /plugins/evidence by @dependabot[bot] in #54
• Howler fields mapping to borealis on UI by @cccs-tsha in #50
• Fixed view filtering by @cccs-mdr in #53
• Add optional parameter to Link model and refactor PivotLink and RelatedLink components by @cccs-mdr in #58
• Fixed view editing to allow changing of view type by @cccs-mdr in #52
• Fixed middle click analytic name in Hit Banner by @cccs-mdr in #55
• Added button to allow users to trigger howler actions in markdown by @cccs-mdr in #59
• Refactored/slimmed down analytic context by @cccs-mdr in #56
• Convert docker images to alpine by @cccs-mdr in #60
• Added clear query button by @cccs-tsha in #61
• Bump mermaid from 11.9.0 to 11.10.0 in /ui by @dependabot[bot] in #64
• Added documentation for Text vs Keyword in Howler by @cccs-tsha in #63
• Improved advanced search functionality by @cccs-mdr in #62
• Fixed JSON search to always show on information pane by @cccs-mdr in #65
• Convert moment to dayjs by @cccs-mdr in #66

Full Changelog: v2.10.0-api...v2.11.0-api