Feature: allow URL input through text file

[berntpopp]

Instead of input from the command line allow input through a list of URLs.
Specify if these should be crawled through their links or not.