04a7a963a8
Merge pull request #1 from Terrtia/master
...
python 3.5 upgrade
2018-04-18 20:36:10 +02:00
Terrtia
6e2dc62f6b
python 2.7 and 3.5 compatibility
2018-04-18 13:51:09 +02:00
Terrtia
388f14df2b
clean
2018-04-18 11:55:46 +02:00
Terrtia
907571d502
python 3.5 upgrade
2018-04-18 11:53:22 +02:00
682260259c
Add a list of software relying on the DomainClassifier library
2017-12-25 15:28:15 +01:00
eb38342b23
0.7 release
2017-07-14 08:27:50 +02:00
a43e2f32c8
0.6 released
2017-07-14 08:19:17 +02:00
8738865aa5
Set a default User-Agent as IANA is filtering based on UA of the HTTP request
2017-07-14 08:16:37 +02:00
6e741ad37c
text method added to classify multiple raw text
...
This used when you have a large set of raw texts that you have
to analyze and you want to avoid the initialisation part.
2014-09-04 22:03:05 +02:00
0ce9d7d1a8
Keep version coherent between PyPi and git
2014-09-04 18:50:20 +02:00
af61175807
Python 3 updates
2014-09-04 18:49:42 +02:00
237dd6bd91
Python package version 0.4
2014-09-04 07:57:17 +02:00
fec097149d
ipaddress() method fixed
...
The ipaddress returns a list of IP addresses associated
with the potential domains found.
2014-09-03 08:46:58 +02:00
7e328b6d8a
PIP install + sample usage
2014-08-31 15:03:45 +02:00
42809b5dbf
version 0.3
2014-08-31 14:52:02 +02:00
90fc808eec
ValidTLD option added
...
A new default option has been introduced in DomainClassifier which
is the validTLD option (enable by default). Based on the assigned
list of TLD, the extraction of potential domains is filtered to the
IANA assigned list.
If you are extracting the data for non-assigned/internal TLDs, you can disable
the default option with validTLD=False on the potentialdomain function.
The list of assigned TLDs is downloaded from IANA.
2014-08-31 14:46:13 +02:00
83fafea305
domain() to potentialdomain() updated
2014-08-22 08:31:29 +02:00
80dc03f59c
potentialdomain() is now called at the init
...
To avoid confusion the method name domain() has
been renamed to potentialdomain().
2014-08-22 08:29:59 +02:00
b32ff4a776
domain() to potentialdomain() method name updated
2014-08-22 08:27:22 +02:00
c954da666c
nameservers are now configurable
2014-08-22 07:26:15 +02:00
2f0afbba44
Version inline with pypi module
2014-08-20 11:00:10 +02:00
680c0f43da
0.2
2014-08-20 10:58:48 +02:00
d116cfc37b
Exception handled for unknown origins
2014-08-20 10:51:55 +02:00
94482dcfbf
Setup script for DomainClassifier
2014-08-18 21:56:11 +02:00
ef75b716bf
PIP requirements.txt added
2014-08-15 16:39:27 +02:00
e967f91e8c
debug removed
2013-06-14 10:34:08 +02:00
c637209267
Documentation updated for ipaddress() method
2013-06-14 10:20:35 +02:00
13c4bf22da
ipaddress() method added
...
This method extracts valid IPv4 addresses from raw text. The validation
is done using the standard socket call. The extended parameter adds the
origin of the IP address via Cymru IP/ASN service.
2013-06-14 10:12:37 +02:00
a3f87b5135
Use Google default recursive server as default resolver.
2013-06-14 09:45:01 +02:00
cddf5b5c63
Documentation updated
2013-04-28 15:19:09 +02:00
5eca33529f
Overview of the methods/flow in DomainClassifier
...
Overview of the methods/flow in DomainClassifier
2013-04-28 16:12:46 +03:00
2c6cc0940e
Flow of operation in DomainClassifier expressed in GraphViz
2013-04-28 15:09:02 +02:00
0be08a31c6
Better error catching
...
- Timeout of DNS reduce to 1 sec
- Socket exception catched
- Ranking default value is now 1.0
2012-03-02 21:12:39 +01:00
738060ab57
Sampling ranking output added
2012-02-19 18:53:49 +01:00
5417fe4911
Domain ranking added to rank your domain
2012-02-19 18:49:04 +01:00
b46192f235
__origin now returns (ASN,CC)
2012-02-19 18:07:09 +01:00
ed9a25d1b7
exclude and include methods added
...
exclude or include domains from a regular expression. If validdomain
was called before, the exclude or include is on the validdomain list
only.
2012-01-31 14:20:51 +01:00
ed376c89e0
sample output
2012-01-24 23:03:09 +01:00
20c6c6a023
Basic pydoc description added
2012-01-24 22:53:20 +01:00
b5bfadb368
Update README to match new DomainClassifier
2012-01-24 11:58:00 +01:00
9f4ae469d9
Test extended to show the use of localizedomain
2012-01-24 11:49:07 +01:00
542c53dcca
DomainClassifier Class extended
...
The class has been extended to add the localizedomain
method to geolocalize DNS records associated for an existing domain.
The localization rely on the Team Cymru ip2asn lookup via DNS.
2012-01-24 11:47:04 +01:00
e2d08d181f
Minimal README added
2012-01-23 17:48:32 +01:00
9eb1e3e4ef
First version of the domain extractor and classify
...
The class domainclassifer got two methods:
- domain() to extract all potential domains from a raw text
The method returns a list.
- validdomain() returning all the existing domains based on their
known DNS records sets like A,AAAA or CNAME records.
The method returns a set. If the extended option is requested, it's a list
of tuples containing the domain with their existing DNS records and
their returned data.
2012-01-23 16:16:01 +01:00
