2021-08-13 20:13:25 +00:00
|
|
|
# Database structure of hashlookup
|
|
|
|
|
|
2021-08-22 14:13:41 +00:00
|
|
|
## hash storage
|
|
|
|
|
|
2021-08-22 17:18:21 +00:00
|
|
|
- `l:<md5>` key/value -> {sha1, sha1}
|
2021-08-23 07:17:20 +00:00
|
|
|
- `h:<sha1>` hash -> keys from NSRL or other data sources
|
2021-08-22 17:20:41 +00:00
|
|
|
- `p:<sha1>` set -> {sha1, sha1} for the parents of a hash (such as original packages)
|
|
|
|
|
- `c:<sha1>` set -> {sha1, sha1} for the children of a hash (such as files contained in a package)
|
2021-08-22 14:13:41 +00:00
|
|
|
|
2021-08-22 14:20:55 +00:00
|
|
|
### Standard keys
|
|
|
|
|
|
|
|
|
|
- `MD5`
|
|
|
|
|
- `SHA-1`
|
|
|
|
|
- `SHA-256`
|
2021-08-31 20:47:44 +00:00
|
|
|
- `TLSH`
|
|
|
|
|
- `SSDEEP`
|
2021-08-22 14:20:55 +00:00
|
|
|
- `FileName`
|
|
|
|
|
- `FileSize`
|
2021-08-24 20:53:53 +00:00
|
|
|
- `PackageArch`
|
|
|
|
|
- `PackageDescription`
|
|
|
|
|
- `PackageMaintainer`
|
|
|
|
|
- `PackageName`
|
|
|
|
|
- `PackageRelease`
|
|
|
|
|
- `PackageVersion`
|
2021-08-31 20:47:44 +00:00
|
|
|
- `KnownMalicious`
|
2021-08-22 14:20:55 +00:00
|
|
|
|
2021-08-13 20:42:41 +00:00
|
|
|
## Publish-Subscribe channels
|
2021-08-13 20:13:25 +00:00
|
|
|
|
2021-08-13 20:42:41 +00:00
|
|
|
- `nx` JSON message of non-existing hashes searched
|
|
|
|
|
- `exist` JSON message of existing hashes searched
|
|
|
|
|
|
|
|
|
|
## Statistics
|
|
|
|
|
|
|
|
|
|
- `s:nx:md5` sorted set of MD5 non-existing hashes
|
|
|
|
|
- `s:nx:sha1` sorted set of SHA1 non-existing hashes
|
|
|
|
|
- `s:exist:md5` sorted set of SHA1 existing hashes
|
2021-08-18 08:17:22 +00:00
|
|
|
- `s:exist:sha1` sorted set of SHA1 existing hashes
|
2021-08-13 20:56:06 +00:00
|
|
|
- `stat:<NSRLname>` string with the number of items imported
|
