Connecting to a website to obtain it's html

Sfpiano · 2005-08-09T11:13:37

I'm not quite sure how to get html from a website. I tried: WORD sockVersion; WSADATA wsaData; int nret; sockVersion = MAKEWORD(1, 1); WSAStartup(sockVersion, &wsaData); LPHOSTENT hostEntry; hostEntry = gethostbyname("www.google.com"); SOCKET theSocket; theSocket = socket(AF_INET, SOCK_STREAM, IPPROTO_TCP); SOCKADDR_IN serverInfo; serverInfo.sin_family = AF_INET; serverInfo.sin_addr = *((LPIN_ADDR)*hostEntry->h_addr_list); serverInfo.sin_port = htons(80); connect(theSocket, (LPSOCKADDR)&serverInfo, sizeof(struct sockaddr)); char buffer[1024]; ZeroMemory(buffer, 1024); strcpy(buffer, "GET /robots.txt HTTP/1.1"); send(theSocket, buffer, strlen(buffer), 0); ... ZeroMemory(buffer, 1024); recv(theSocket, buffer, 1024, 0); But my program hangs on the receive call. (I have error checks in my code, but I removed them to save space.) [Edited by - Sfpiano on August 8, 2005 1:12:31 AM]

Networking and Multiplayer Programming

Started by Sfpiano August 08, 2005 12:35 AM

12 comments, last by hplus0603 19 years, 6 months ago

Sfpiano

Author

126

August 08, 2005 12:12 PM

How do I access sites that don't start with www like:

swbd.netfirms.com

I tried GET / HTTP/1.1\nHost: www.netfirms.com\n\n

But got 503 unknown site.

Also, I want to see if I have the command submission correct. Do I put \n after every command and \n\n after the final command?

[Edited by - Sfpiano on August 8, 2005 2:12:46 PM]

//------------------------------------------------------------------------------------------------------The great logician Bertrand Russell once claimed that he could prove anything if given that 1+1=1. So one day, some fool asked him, "Ok. Prove that you're the Pope." He thought for a while and proclaimed, "I am one. The Pope is one. Therefore, the Pope and I are one."

hplus0603

11,940

August 08, 2005 03:27 PM

You put \r\n after each line, and end with an additional blank line (so \r\n\r\n).

For Host, put in the actual site host. If the site is foo.bar.com, then use Host: foo.bar.com\r\n

You probably want to also include a User-Agent: and an Accept: header.

enum Bool { True, False, FileNotFound };

zppz

226

August 09, 2005 03:26 AM

Using HTTP 1.0 simplifies things somewhat.

Box2D C++ tutorials

hplus0603

11,940

August 09, 2005 11:13 AM

If you don't use the Host: header, then most of the virtual hosting on the web today won't get right. Also, you can make 1.1 much easier to deal with by sending connection close headers, so the server won't think you'll re-use the connection.

enum Bool { True, False, FileNotFound };

Connecting to a website to obtain it's html

This topic is closed to new replies.

Popular Topics

Recommended Tutorials

Connecting to a website to obtain it's html

This topic is closed to new replies.

Popular Topics

Recommended Tutorials

Reticulating splines