Reputation
Top tag
Next privilege 125 Rep.
Vote down
Badges
1 5
Impact
~4k people reached

  • 0 posts edited
  • 0 helpful flags
  • 1 vote cast
Feb
1
awarded  Notable Question
Feb
1
awarded  Popular Question
Jan
2
awarded  Scholar
Jan
2
awarded  Supporter
Jan
2
accepted What will happen if I don't follow robots.txt while crawling?
Dec
20
awarded  Nice Question
Dec
20
awarded  Student
Dec
20
asked What will happen if I don't follow robots.txt while crawling?