hashlookup-server/bin/import_NSRLSHA256.py
Alexandre Dulaunoy a4b3b7ba60
new: [hashlookup-server] initial import of the code
- This includes a simple HTTP server for doing bulk and lookup of hashes.
- A simple DNS server to do lookup via DNS
- Various import script for NSRL

This works on a test instance.

TODO:

- Automatic script for NSRL download and import
- Bloomfilter export
- Improved documentation
2021-07-15 17:49:52 +02:00

25 lines
689 B
Python

import sys
import redis
rdb = redis.Redis(host='127.0.0.1', port='6666', decode_responses=True)
lines = open('../data/rds241-sha256.txt', 'r')
ln = 0
rdb.delete("stat:NSRLsha256-import")
maxvalue = 500000000
headers = ['SHA-1', 'SHA-256', 'filename']
for l in lines:
records = l.rstrip().split("\t")
drecords = {}
for index, value in enumerate(records):
try:
drecords[headers[index]] = value
except:
continue
print(drecords)
print(drecords['SHA-1'])
#rdb.hmset("h-ProductCode:{}".format(drecords['ProductCode']), drecords)
rdb.incrby("stat:NSRLsha256-import")
if ln == maxvalue:
sys.exit(1)
ln = ln + 1