v1.1.1

projectdiscovery/katanav1.1.1Oct 28, 2024by dogancanbakir

AI Summary

This release removes the passive crawling feature, separating it into a new project called `urlfinder`, while introducing new file handling and header configuration options.

Key Highlights

  • Removed passive crawling capability (moved to `urlfinder`).
  • Added `-no-clobber` flag to prevent file overwriting.
  • Added `-store-field-dir` flag for custom field storage.
  • Fixed cookie and header handling in various modes.

Breaking Changes

  • Passive crawling capability is removed and released as a separate project

New Features

  • No-clobber flag
  • Store field directory flag
  • Response parser for htmx attributes
  • Automatic form filling for select and textarea

Full Release Notes

## ⚠️ Breaking Changes:
The Passive Crawling capability is being removed from katana and released as a separate project [urlfinder](https://github.com/projectdiscovery/urlfinder) by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/899
```
PASSIVE:
    -ps, -passive                   enable passive sources to discover target endpoints
    -pss, -passive-source string[]  passive source to use for url discovery (waybackarchive,commoncrawl,alienvault)
```


## What's Changed
### 🎉 New Features
* Added `no-clobber` flag to prevent katana from overwriting existing local files. by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/827
```
-ncb, -no-clobber                 do not overwrite output file
```
* Added `-store-field-dir` flag to make per-host field directory optional by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/877
```
   -sfd, -store-field-dir string     store per-host field to custom directory
```


### 🐞 Bug Fixes
* Fixed improper logging configuration by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/825
* Fixed the issue with setting custom headers/cookie headers by @RamanaReddy0M in https://github.com/projectdiscovery/katana/pull/813
* Fixed header marshalling issue by preserving the header name casing by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/924
* Fixed ignoring form data extraction with `-form-extraction` when action is "#" by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/1052
* Fixed initial host scope checks to allow continued crawling when `-crawl-scope` is used by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/858
* Fixed duplicate field output when multiple value is used with `-field` flag by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/1031
* Fixed Dockerfile build errors by updating Golang by @dualfade in https://github.com/projectdiscovery/katana/pull/1034
* Fixed issue where Ctrl-c could not terminate the process in headless mode with `-show-browser` option by @zrquan in https://github.com/projectdiscovery/katana/pull/972
* Fixed the issue with setting custom headers/cookie headers in headless mode by @michael2to3 in https://github.com/projectdiscovery/katana/pull/868
* Fixed cookie handling in hybrid mode to include in output by @alban-stourbe-wmx in https://github.com/projectdiscovery/katana/pull/936



### Other Changes
* The leakless switch is now enabled by default in headless mode, ensuring the browser is terminated when the Go process ends by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/831
* Updated README for recently introduced flag `-e` by @zy9ard3 in https://github.com/projectdiscovery/katana/pull/826
* Corrected typos in comments by @eveneast in https://github.com/projectdiscovery/katana/pull/851
* Added directive to ensure compatibility with Windows OS or 386 architecture by @Mzack9999 in https://github.com/projectdiscovery/katana/pull/841
* Added deduplication for stored the fields on scan completion by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/885
* Updated README for installation command by @dwisiswant0 in https://github.com/projectdiscovery/katana/pull/1015
* Added a response parser to extract endpoints from htmx attributes by @zrquan in https://github.com/projectdiscovery/katana/pull/994
* Updated chrome launcher logic to prioritize the specified Chrome path with `-scp` over default paths by @zrquan in https://github.com/projectdiscovery/katana/pull/979
* Added automatic form filling for select and textarea in forms by @alban-stourbe-wmx in https://github.com/projectdiscovery/katana/pull/921
* Disabled headless auto form filling by @dogancanbakir in https://github.com/projectdiscovery/katana/pull/918
* Added more JavaScript Libraries to improve parsing coverage by @geeknik in https://github.com/projectdiscovery/katana/pull/900
* Corrected path handling with filepath.Join to use OS-specific separators. @ShuBo6 in https://github.com/projectdiscovery/katana/pull/883
* Updated Dockerfile to recent Golang and Alpine images by @o6uoq in https://github.com/projectdiscovery/katana/pull/886
* Improved form extraction logic to use HTML placeholder if input value is missing by @fmuttis in https://github.com/projectdiscovery/katana/pull/957

## New Contributors
* @zy9ard3 made their first contribution in https://github.com/projectdiscovery/katana/pull/826
* @eveneast made their first contribution in https://github.com/projectdiscovery/katana/pull/851
* @ShuBo6 made their first contribution in https://github.com/projectdiscovery/katana/pull/883
* @o6uoq made their first contribution in https://github.com/projectdiscovery/katana/pull/886
* @michael2to3 made their first contribution in https://github.com/projectdiscovery/katana/pull/868
* @alban-stourbe-wmx made their first contribution in https://github.com/projectdiscovery/katana/pull/936
* @zrquan made their first contribution in https://github.com/projectdiscovery/katana/pull/972
* @fmuttis made their first contribution in https://github.com/projectdiscovery/katana/pull/957
* @dualfade made their first contribution in https://github.com/projectdiscovery/katana/pull/1034
* @dwisiswant0 made their first contribution in https://github.com/projectdiscovery/katana/pull/1015

**Full Changelog**: https://github.com/projectdiscovery/katana/compare/v1.1.0...v1.1.1