List HTTP methods:

curl -i -X OPTIONS
-i flag to include protocol response headers in the output.

Screenshot 2018-03-30 14.38.02
Grab HTTP Server Banners:

curl --head
--head flag to only grab headers of the site.

Screenshot 2018-03-30 14.33.17
Grab robots.txt file:


Screenshot 2018-03-30 14.42.12

If you want to include the headers in this request, apply the -i flag. (Shown in screenshot above.)