Can Google or other search engines (robots) scan SSL/HTTPS pages/websites? [closed] - search

Closed. This question needs details or clarity. It is not currently accepting answers.
Want to improve this question? Add details and clarify the problem by editing this post.
Closed 8 years ago.
Improve this question
Well, the title pretty much states the question...

SSL secures the communications, it does not provide content access mechanisms.
As long as there is no password/authentication restricting access to the pages, there's no reason a search engine would be unable to index them.

Yes.
They may choose not to spider over HTTPS, or they may choose to rate lower those sites that are available only over HTTPS, or they may choose to do any number of things. But they can certainly spider the Web over HTTPS just as easily as your browser can view a single Web page over HTTPS.

Related

Hiding folders from search engines [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
How to mark folder hidden for all search engines?
How many alternatives are there?
Which one is the most reliable?
To prevent search engines from visiting certain directories/urls it is common practice to use robots.txt. This is a file that search engines take a look at before spidering your website.
robots.txt
User-agent: *
Disallow: /secret/
This file should be placed in your website root. For example http://www.example.com/robots.txt
There are two important considerations when using /robots.txt:
robots can ignore your /robots.txt. Especially malware robots that scan the web for security vulnerabilities, and email address harvesters used by spammers will pay no attention.
the /robots.txt file is a publicly available file. Anyone can see what sections of your server you don't want robots to use.

Is it possible to make a website which can be accessable from only some specific locations? [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 7 years ago.
Improve this question
I am planning to make a small blog website which can be accessed from our state only.Is there any way to reach this goal.Please help me out.
You cannot do that - simple as that.
You can try a few things to raise a bar, but a determined attacker will be able to overcome the restriction.
Depending on your definition of state you can try a simple firewall. It can be easy if it's a range of IP addresses. But it may be easy to overcome this as well with VPN
You can add authentication and only allow users that can pass authentication. You need to have a process to grant login details only to specific users

Is there any reason not to redirect all HTTP traffic to HTTPS? [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 7 years ago.
Improve this question
I just wrote a rule in my .htaccess to redirect all HTTP traffic to HTTPS. It seems pretty common, but I was just wondering if that could have any negative effect. As far as I know it actually helps as far as SEO is concerned. Is there any scenario where a user wants non secure access, can't access a secured site or anything like that? Or am I missing something else besides SEO and accessibility?
There's a post about this on Server Fault. The consensus appears to be that this is a good idea.
This blog post covers some of the drawbacks. There's also this post from the Information Security Stack Exchange.
If you use AdSense, you might see a decrease in earnings due to the forced SSL compliance.
Your site may perform differently than it would using HTTP.

The most important web application vulnerabilities [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 8 years ago.
Improve this question
As the matter of web applications vulnerabilities is one of the most important issues in the today's security problems/threats , so I'm interested in knowing what kind of such vulnerabilities are the most important one.
Indeed, which one of them have been affecting websites in recently years ?
So thanks.
#elsadek suggestion is good. This is a partial answer to your big question. Some of what comes to mind is below but hte list is not enclusive by any means...):
1-Injection (SQL and/or JSON pair injection)
2-Cross site scripting (XSS)
3-Broken Authentication & Session Management
4-Insecure Direct Object Reference
5-Cross Site Request Forgery (CSRF)
6-Security Misconfig
7-Insecure Cryptography Storage
8-Failiure to restrict URL Access
9-Insufficint Tansport Layer Protection
10-Unvalidated redirects and forwards
11-Deniel of service attacks
12-Log spoofing
13-JS Hijacking
14-Buffer overflow
15-Bad security administration and security policy regarding passwords specification and update
Some others are listed here for example: 10 Security Holes.

Using DNS based system to unblock a blocked URL? [closed]

Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
Okay I understand that this might be a silly question.
I'm looking forward to unblock Youtube in my country. I'm quite sure its a simple address/url block. I currently have to use proxies which reduce the speed of the connection. I tried to use the IP of Youtube to open it up but Youtube's IP actually opens up Google.com so that it is of no use.
I was also thinking of something like creating a DNS entry on one of my sub-domains that might point to Youtube's URL in some way but that might not be possible as I don't really know how DNS systems work at all. So some guesses might help. I'm not sure of some other hidden URLs that point to Youtube or even if some exist. So they might help as well.
May be using VPN connection to some provider that does not block the traffic would help? This one for example: http://privateinternetaccess.com

Resources