Appending a column to large csv file - python-3.x

I have uploaded a large csv into python using the following code:
ddgqa = pd.read_table("/Users/xxxx/Documents/globalqa-pageurls-Report.csv", chunksize= 10**6, iterator=True)
I am now extract a column into a dataframe using this code:
for chunk in ddgqa:
links_adobe_ddgqa = pd.DataFrame(ddga['Page URL'])
When I try to links_adobe_ddgqa
I get the following error:
---------------------------------------------------------------------------
NameError Traceback (most recent call last)
<ipython-input-95-1ab6eaf23d5f> in <module>()
----> 1 links_adobe_ddgqa
NameError: name 'links_adobe_ddgqa' is not defined
What am I missing? Is there a better way to accomplish this?

Related

KeyError using format with python

I'm new in python and i'm getting this error while trying to run my code
KeyError Traceback (most recent call last)
<ipython-input-201-74e7a7ea82f3> in <module>
----> 1 SEARCH['profession']['call'].format('Jhon',23)
KeyError: '"sea'
This is my code, I am trying to use the format in a string that simulates a dictionary
SEARCH = {
'profession' : {"call":'{"sea:searchProfession":{"datasheet": {"name":{},"age": {}}}}'},
'id' : {"call":'{"sea:searchId":{"personId": {"id":{},"name": {},"age":"{}"}}}'},
}
SEARCH['profession']['call'].format('Jhon',23)
I know there are similar issues, but I have not found the solution

How can I use 'torch.utils.mobile_optimizer' in PyTorch 1.6.0?

According to https://pytorch.org/docs/stable/mobile_optimizer.html (currently for 1.6.0)
Torch mobile supports torch.mobile_optimizer.optimize_for_mobile utility to run a list of optimization pass with modules in eval mode. The method takes the following parameters: a torch.jit.ScriptModule object, a blacklisting optimization set and a preserved method list
The page title and
torch.utils.mobile_optimizer.optimize_for_mobile(script_module, optimization_blacklist: Set[torch._C.MobileOptimizerType] = None)
at the end suggest it should be torch.utils.mobile_optimizer instead. However, neither work for me:
In [25]: module1 = torch.utils.mobile_optimizer.optimize_for_mobile(module)
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
<ipython-input-25-79e42fe53cdf> in <module>
----> 1 module1 = torch.utils.mobile_optimizer.optimize_for_mobile(module)
AttributeError: module 'torch.utils' has no attribute 'mobile_optimizer'
In [26]: module1 = torch.mobile_optimizer.optimize_for_mobile(module)
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
<ipython-input-26-469dd450df3d> in <module>
----> 1 module1 = torch.mobile_optimizer.optimize_for_mobile(module)
AttributeError: module 'torch' has no attribute 'mobile_optimizer'
In [27]: print(torch.__version__)
1.6.0
Am I missing anything? E.g. do I have to install some package other than torch itself?
import torch.utils.mobile_optimizer as mobile_optimizer
scripted_model = torch.jit.script(model, pt_inputs)
opt_model = mobile_optimizer.optimize_for_mobile(scripted_model)
torch.jit.save(opt_model, "model.pt")
It works for me

Trouble pickling a list in jupyter

so I created a book class and added its instances to a list that I'm trying to pickle but I'm getting a strange error. Help appreciated!
with open("book_data/books.pkl", "wb") as f:
pickle.dump(book_list, f)
Output:
PicklingError Traceback (most recent call last)
<ipython-input-24-45ad0cec62df> in <module>
1 with open("book_data/books.pkl", "wb") as f:
2
----> 3 pickle.dump(book_list, f)
PicklingError: Can't pickle <class '__main__.book'>: it's not the same object as __main__.book

global variables inside function python 3.x

guys i am new in python and for some reason the word global not working for me
ex
def location():
global place
place = "Cape Town"
return
and when i am trying to print place
print(place)
i am facing that error
NameError Traceback (most recent call last)
<ipython-input-2-34a3a4594339> in <module>()
----> 1 print(place)
NameError: name 'place' is not defined

Jupyter notebook

I am trying to run this code in jupyter notebook but I am getting the following error for fuzzyset package. I am using fuzzyset version 0.0.9. Does anybody know how to convert these dictionary values to list?
agrovocSimple = []
with open('agrovocLabels.json') as data_file:
agrovoc = json.load(data_file)
results = agrovoc["results"]["bindings"]
for entry in results:
uri = entry["uri"]["value"]
label = entry["label"]["value"]
#agrovocSimple.append({"uri": uri , "name": label})
agrovocSimple.append(label)
####instatiation of the fuzzyset for the mappings
# allocate the FuzzySet object
a=FuzzySet()
for e in agrovocSimple:
a.add(e)
####TypeError Traceback (most recent call last)
<ipython-input-19-bc4871be0e65> in <module>()
17 a=FuzzySet()
18 for e in agrovocSimple:
---> 19 a.add(e)
fuzzyset\cfuzzyset.pyx in cfuzzyset.cFuzzySet.add()
fuzzyset\cfuzzyset.pyx in cfuzzyset.cFuzzySet._add()
TypeError: Expected list, got dict_values

Resources