Starstruk Logo MarkStarstruk

4.4.0

laramies/theHarvester4.4.0Jul 22, 2023by L1ghtn1ng

AI Summary

Adds new data collection modules (Netlas, Tomba), improves takeover detection logic, and updates core dependencies including FastAPI and Pydantic.

Key Highlights

  • Added Netlas module
  • Added Tomba module
  • Updated takeover checks to be more thorough
  • Fixed string splicing bug
  • Security fix in base image

New Features

  • Netlas module integration
  • Tomba module integration
  • ujson integration replacing json
  • Optimized Brave and Sitedossier search
  • Optimized resolvers and output file handling

Full Release Notes

## What's Changed
* chore(deps): bump setuptools from 67.7.2 to 67.8.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1429
* Update rocketreach api endpoint by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1432
* chore(deps): bump requests from 2.30.0 to 2.31.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1434
* chore(deps-dev): bump types-pyyaml from 6.0.12.9 to 6.0.12.10 by @dependabot in https://github.com/laramies/theHarvester/pull/1433
* chore(deps-dev): bump types-requests from 2.30.0.0 to 2.31.0.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1438
* chore(deps-dev): bump pydantic from 1.10.7 to 1.10.8 by @dependabot in https://github.com/laramies/theHarvester/pull/1436
* Doc updates by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1440
* add netlas module by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1439
* chore(deps-dev): bump pydantic from 1.10.8 to 1.10.9 by @dependabot in https://github.com/laramies/theHarvester/pull/1444
* chore(deps): bump fastapi from 0.95.2 to 0.96.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1443
* chore(deps): bump fastapi from 0.96.0 to 0.97.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1448
* chore(deps-dev): bump pytest from 7.3.1 to 7.3.2 by @dependabot in https://github.com/laramies/theHarvester/pull/1446
* chore(deps): bump ujson from 5.7.0 to 5.8.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1449
* chore(deps-dev): bump types-ujson from 5.7.0.5 to 5.8.0.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1447
* chore(deps-dev): bump pytest from 7.3.2 to 7.4.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1456
* chore(deps): bump fastapi from 0.97.0 to 0.99.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1459
* chore(deps-dev): bump pydantic from 1.10.9 to 2.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1458
* Fix a bug about string splicing by @captain686 in https://github.com/laramies/theHarvester/pull/1460
* chore(deps): bump fastapi from 0.99.0 to 0.99.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1461
* Added two new sources, updated to use ujson instead of json, Optimized Brave and Sitedossier Search and other misc changes by @NotoriousRebel in https://github.com/laramies/theHarvester/pull/1463
* chore(deps-dev): bump mypy from 1.3.0 to 1.4.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1457
* chore(deps): bump setuptools from 67.8.0 to 68.0.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1452
* chore(deps): bump censys from 2.2.2 to 2.2.3 by @dependabot in https://github.com/laramies/theHarvester/pull/1450
* chore(deps): bump lxml from 4.9.2 to 4.9.3 by @dependabot in https://github.com/laramies/theHarvester/pull/1465
* chore(deps-dev): bump pydantic from 2.0 to 2.0.2 by @dependabot in https://github.com/laramies/theHarvester/pull/1464
* chore(deps): bump censys from 2.2.3 to 2.2.4 by @dependabot in https://github.com/laramies/theHarvester/pull/1466
* chore(deps): bump fastapi from 0.99.1 to 0.100.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1467
* add missing hunterhow api key entry by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1469
* chore(deps-dev): bump pytest-asyncio from 0.21.0 to 0.21.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1471
* Updated takeover checks to be more thorough and show in output file and fixed bug when using resolvers and output file by @NotoriousRebel in https://github.com/laramies/theHarvester/pull/1470
* chore(deps-dev): bump pydantic from 2.0.2 to 2.0.3 by @dependabot in https://github.com/laramies/theHarvester/pull/1472
* chore(deps): bump uvicorn from 0.22.0 to 0.23.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1475
* chore(deps): bump dnspython from 2.3.0 to 2.4.0 by @dependabot in https://github.com/laramies/theHarvester/pull/1474
* chore(deps): bump pyyaml from 6.0 to 6.0.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1476
* chore(deps): bump aiohttp from 3.8.4 to 3.8.5 by @dependabot in https://github.com/laramies/theHarvester/pull/1478
* Add tomba module by @benemohamed in https://github.com/laramies/theHarvester/pull/1479
* chore(deps-dev): bump types-requests from 2.31.0.1 to 2.31.0.2 by @dependabot in https://github.com/laramies/theHarvester/pull/1483
* chore(deps-dev): bump types-ujson from 5.8.0.0 to 5.8.0.1 by @dependabot in https://github.com/laramies/theHarvester/pull/1482
* chore(deps-dev): bump types-python-dateutil from 2.8.19.13 to 2.8.19.14 by @dependabot in https://github.com/laramies/theHarvester/pull/1481
* chore(deps-dev): bump types-pyyaml from 6.0.12.10 to 6.0.12.11 by @dependabot in https://github.com/laramies/theHarvester/pull/1480
* flake8 fixes by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1484
* fix security issue with base image by @L1ghtn1ng in https://github.com/laramies/theHarvester/pull/1485

## New Contributors
* @captain686 made their first contribution in https://github.com/laramies/theHarvester/pull/1460
* @benemohamed made their first contribution in https://github.com/laramies/theHarvester/pull/1479

**Full Changelog**: https://github.com/laramies/theHarvester/compare/4.3.0...4.4.0