Ask Question Forum:
Model Library:2025-02-08:A.I. model is online auto reply
C
O
M
P
U
T
E
R
2
8
Show
#
ASK
RECENT
←
- Underline
- Bold
- Italic
- Indent
- Step
- Bullet
- Quote
- Cut
- Copy
- Paste
- Table
- Spelling
- Find & Replace
- Undo
- Redo
- Link
- Attach
- Clear
- Code
Below area will not be traslated by Google,you can input code or other languages
Hint:If find spelling error, You need to correct it,1 by 1 or ignore it (code area won't be checked).
X-position of the mouse cursor
Y-position of the mouse cursor
Y-position of the mouse cursor
Testcursor
caretPos
Attachment:===
Asked by duncanb7
at 2024-11-24 00:11:15
ModifyPoint:500 Replies:13 POST_ID:828570USER_ID:11059
Topic:
PHP Scripting Language;JavaScript;Apache Web Server
I get one php curl program to put in cron-job to do data extract
from one remote site on my hosting server company daily with
my domain name or IP address. It works fine everyday.
Yesterday my hosting company server is down for whole day and my worksite
is not working at all of course, since then the server is back to be normal or fixed but
I can't connect to the remote site again, other remote sites are okay for connection.
After debugging, I found I can use my home PC connected to the remote site and
run the php program on xammp server at my home PC successfully.
(Be reminded, it is hard to block my ISP IP address at my home PC when I do the
the remote site connection, since my ISP IP can be dynamic when my phone line is on and off , the remote site is not easy to block my access)
Up to this moment, I still not be able to connect the remote site
from my website on my hosting company.
I think the remote site blocked my domain name to access into its
server because I guess my php program running yesterday at the hosting company server down period will hang up the remote site server for long time. SO they
decided to block my domain name
How to avoid to block my IP address when I access the remote site through
my php curl program. Some people tells me it may use proxy to filter out
remote site blocking but How.
Any idea to solve my issue
Please advise
Duncan
Expert: modus_operandi replied at 2024-11-24 14:15:13
duncanb7,
I changed the grade here to an 'A'. You may not have liked the answer you got, but the answer was no less correct.
modus_operandi
EE Admin
I changed the grade here to an 'A'. You may not have liked the answer you got, but the answer was no less correct.
modus_operandi
EE Admin
Expert: Ray Paseur replied at 2024-11-24 11:39:51
@duncanb7: You got exactly the right answers here, yet you gave the worst possible grade anyone can give at EE. Please explain to us why we should try to help you the next time you post a question.
Author: duncanb7 replied at 2024-11-24 11:16:27
Thanks for all your rely
DUncan
DUncan
Author: duncanb7 replied at 2024-11-24 11:15:37
So I may let it be,just leave yahoo away to solve the issue
In Internet world anything can happen
In Internet world anything can happen
Accepted Solution
Expert: COBOLdinosaur replied at 2024-11-24 08:32:45
100 points EXCELLENT
The problem with using proxies is that they are often infected with malware and are on blacklists that get routinely blocked. You might find a proxy that works for a time, but overtime they all get blocked; and this kind of setup is much less efficient.
As for your right to the information; you have none. It may be a public site with free access, but the owner still has the right to restrict how it may be access and by whom.
The real problem is with your ISP. They need to get the ip off of the blacklist and resolve the blocking issue with Yahoo; otherwise the problem will re-occur no matter what you do.
Cd&
As for your right to the information; you have none. It may be a public site with free access, but the owner still has the right to restrict how it may be access and by whom.
The real problem is with your ISP. They need to get the ip off of the blacklist and resolve the blocking issue with Yahoo; otherwise the problem will re-occur no matter what you do.
Cd&
Author: duncanb7 replied at 2024-11-24 08:25:23
DO you have any suggestion if I already clarify the remote is
no license and no law issue for data collection ?
no license and no law issue for data collection ?
Author: duncanb7 replied at 2024-11-24 08:23:21
it is free site and welcome to download any data.
like the data in yahoo finance stock data.
No any ethical and relationship issue
The issue to how to go through the issue casused by sudden server down on
my hosting company machine.
And probably you can NOT contact any one who can help you on the content
owner site.
So back to the issue which is how to hide the IP address to access the site
I heard people always using Proxy with curl to hide address. You know How ?
Of course I connect to the remote site which is free website for people
to access and collect data without any license and law issue.
like the data in yahoo finance stock data.
No any ethical and relationship issue
The issue to how to go through the issue casused by sudden server down on
my hosting company machine.
And probably you can NOT contact any one who can help you on the content
owner site.
So back to the issue which is how to hide the IP address to access the site
I heard people always using Proxy with curl to hide address. You know How ?
Of course I connect to the remote site which is free website for people
to access and collect data without any license and law issue.
Assisted Solution
Expert: COBOLdinosaur replied at 2024-11-24 07:42:20
100 points EXCELLENT
BTW if that ip you posted is the one you are using the problem may also be because the ip is blacklisted by Spamhaus because of a PBL advisory for its mail server policy.
Cd&
Cd&
Assisted Solution
Expert: COBOLdinosaur replied at 2024-11-24 07:34:28
100 points EXCELLENT
I agree with Ray. You do not have a technical issue. You have a relationship issue. The publisher owns the content. If they charge for it or do not want you to have it, then then trying to go around the block is theft.
Cd&
Cd&
Assisted Solution
Expert: Ray Paseur replied at 2024-11-24 06:12:03
100 points EXCELLENT
Suggest you contact the publisher and request an API. If you're taking their information without their permission, it is unethical and may have legal consequences. If they want you to take and reuse their information they will give (or license) an API.
cURL can make any part of the request say anything you want it to say, and you can even make your script appear to be a Firefox client referred by Google. But that aside, if the publisher is blocking your access to the data, the problem is not cURL -- it's your relationship with the publisher.
cURL can make any part of the request say anything you want it to say, and you can even make your script appear to be a Firefox client referred by Google. But that aside, if the publisher is blocking your access to the data, the problem is not cURL -- it's your relationship with the publisher.
Author: duncanb7 replied at 2024-11-24 04:03:34
Do you have any method to hide my domain name IP address when
I do curl php program ?
I do curl php program ?
Author: duncanb7 replied at 2024-11-24 04:01:29
my hosting company server will just show my domain name IP address and
probably it won't show my ISP address or location to others for privacy
for example, www.mywebsite.com and its 65.103.123.101 can be captured
by the remote site but not my ISP address through hosting company.
But when I do it at home xammp server on my PC, it will show my
ISP address to the remote site, but the ISP address is dynamic address
that is not fix IP adrress. So the remote site is hard to block except
they block all such ISP phone company IP address from the whole range of IP provided
by the company, But no one will be silly to do that since most ISP IP address is dynamic.
I send the link to you , but you should connect the site through curl php program and
capture the page data, the link is http://www.yahoo.com/us
Hope you understand what I want, any proxy to hide my domain name IP address?
probably it won't show my ISP address or location to others for privacy
for example, www.mywebsite.com and its 65.103.123.101 can be captured
by the remote site but not my ISP address through hosting company.
But when I do it at home xammp server on my PC, it will show my
ISP address to the remote site, but the ISP address is dynamic address
that is not fix IP adrress. So the remote site is hard to block except
they block all such ISP phone company IP address from the whole range of IP provided
by the company, But no one will be silly to do that since most ISP IP address is dynamic.
I send the link to you , but you should connect the site through curl php program and
capture the page data, the link is http://www.yahoo.com/us
Hope you understand what I want, any proxy to hide my domain name IP address?
Assisted Solution
Expert: insoftservice replied at 2024-11-24 03:14:54
100 points EXCELLENT
Do the remote site provides the info for free ?
Please provide the link so that i would check it from my ip too.
As many such site has there own limitation to provide the info to certain site. Even ur ip is dynamic its not an public ip.
You ISP provides an public to your hosting company even if your ip has been changed at your end.
Some, company even capture the mac address and block the ips .
So, its advisable to inform customer support of the remote site.
Please provide the link so that i would check it from my ip too.
As many such site has there own limitation to provide the info to certain site. Even ur ip is dynamic its not an public ip.
You ISP provides an public to your hosting company even if your ip has been changed at your end.
Some, company even capture the mac address and block the ips .
So, its advisable to inform customer support of the remote site.
