Basic CURL commands

List HTTP methods:

curl -i -X OPTIONS
-i flag to include protocol response headers in the output. Screenshot 2018-03-30 14.38.02

Grab HTTP Server Banners:

curl --head
--head flag to only grab headers of the site. Screenshot 2018-03-30 14.33.17

Grab robots.txt file:

Screenshot 2018-03-30 14.42.12
If you want to include the headers in this request, apply the -i flag. (Shown in screenshot above.)