i need help scraping the following information from the webpage - python-3.x

Question

i need to obtain details of federal agencies from a web page that lists the pages alphabetically a-w. I need to get the agency name,website and contact
the code that i have only returns the agency name from one page.
import requests
>>> import bs4
>>> res = requests.get("https://www.usa.gov/federal-agencies/")
>>> soup=bs4.BeautifulSoup(res.text,'lxml')
>>> soup.select('.url')
for i in soup.select('.url'):
print(i.text)
i expect to get; the Agency name, website and contact address for all the pages,from a to page w

Answer 1

You are going to have to iterate through each page, and follow the link of each item to then pull the data you want:
Code:
import requests
import bs4
for letter in map(chr, range(97, 123)):
res = requests.get("https://www.usa.gov/federal-agencies/%s" %letter)
soup=bs4.BeautifulSoup(res.text,'lxml')
section = soup.find('ul', {'class':'one_column_bullet'})
links = [ 'https://www.usa.gov' + i['href'] for i in section.find_all('a', {'class':'url'})]
for link in links:
res2 = requests.get(link)
soup=bs4.BeautifulSoup(res2.text,'lxml')
agency_name = soup.find('h1').text
website = soup.find('h3',{'class':'org'}).findNext('a')['href']
try:
address = soup.find('p',{'class':'spk street-address'}).text.strip()
address = address.split('\n')
address = ' '.join([ i.strip() for i in address if i.strip() != '' ])
except:
address = 'N/A'
print('Name:\t\t%s\nWebsite:\t%s\nAddress:\t%s\n' %(agency_name, website, address))
Output:
Name: U.S. AbilityOne Commission
Website: http://www.abilityone.gov
Address: 1401 S. Clark Street Suite 715 Arlington, VA 22202-3259
Name: U.S. Access Board
Website: http://www.access-board.gov/
Address: 1331 F St., NW Suite 1000 Washington, DC 20004-1111
Name: Administration for Children and Families
Website: http://www.acf.hhs.gov/
Address: 330 C St., SW Washington, DC 20201
Name: Administration for Community Living
Website: http://www.acl.gov
Address: One Massachusetts Ave., NW Washington, DC 20201
Name: Administration for Native Americans
Website: http://www.acf.hhs.gov/programs/ana/
Address: 2nd Floor, West Aerospace Center 370 L'Enfant Promenade, SW Washington, DC 20447-0002
Name: Administrative Conference of the United States
Website: http://acus.gov/
Address: 1120 20th St., NW Suite 706 South Washington, DC 20036
Name: Administrative Office of the U.S. Courts
Website: http://www.uscourts.gov/
Address: One Columbus Circle, NE Washington, DC 20544
...