👻 Check our latest review to choose the best laptop for Machine Learning engineers and Deep learning tasks!
I have a really large csv file that I opened in pandas as follows....
import pandas
df = pandas.read_csv("large_txt_file.txt")
Once I do this my memory usage increases by 2GB, which is expected because this file contains millions of rows. My problem comes when I need to release this memory. I ran....
del df
However, my memory usage did not drop. Is this the wrong approach to release memory used by a pandas data frame? If it is, what is the proper way?
👻 Read also: what is the best laptop for engineering students?
How do I release memory used by a pandas dataframe? __del__: Questions
How can I make a time delay in Python?
5 answers
I would like to know how to put a time delay in a Python script.
Answer #1
import time
time.sleep(5) # Delays for 5 seconds. You can also use a float value.
Here is another example where something is run approximately once a minute:
import time
while True:
print("This prints once a minute.")
time.sleep(60) # Delay for 1 minute (60 seconds).
Answer #2
You can use the sleep()
function in the time
module. It can take a float argument for sub-second resolution.
from time import sleep
sleep(0.1) # Time in seconds
How do I release memory used by a pandas dataframe? __del__: Questions
How to delete a file or folder in Python?
5 answers
How do I delete a file or folder in Python?
Answer #1
os.remove()
removes a file.os.rmdir()
removes an empty directory.shutil.rmtree()
deletes a directory and all its contents.
Path
objects from the Python 3.4+ pathlib
module also expose these instance methods:
pathlib.Path.unlink()
removes a file or symbolic link.pathlib.Path.rmdir()
removes an empty directory.
We hope this article has helped you to resolve the problem. Apart from How do I release memory used by a pandas dataframe?, check other __del__-related topics.
Want to excel in Python? See our review of the best Python online courses 2023. If you are interested in Data Science, check also how to learn programming in R.
By the way, this material is also available in other languages:
- Italiano How do I release memory used by a pandas dataframe?
- Deutsch How do I release memory used by a pandas dataframe?
- Français How do I release memory used by a pandas dataframe?
- Español How do I release memory used by a pandas dataframe?
- Türk How do I release memory used by a pandas dataframe?
- Русский How do I release memory used by a pandas dataframe?
- Português How do I release memory used by a pandas dataframe?
- Polski How do I release memory used by a pandas dataframe?
- Nederlandse How do I release memory used by a pandas dataframe?
- 中文 How do I release memory used by a pandas dataframe?
- 한국어 How do I release memory used by a pandas dataframe?
- 日本語 How do I release memory used by a pandas dataframe?
- हिन्दी How do I release memory used by a pandas dataframe?
Warsaw | 2023-03-24
Simply put and clear. Thank you for sharing. How do I release memory used by a pandas dataframe? and other issues with __del__ was always my weak point 😁. Checked yesterday, it works!
Moscow | 2023-03-24
Thanks for explaining! I was stuck with How do I release memory used by a pandas dataframe? for some hours, finally got it done 🤗. Will get back tomorrow with feedback
Texas | 2023-03-24
Simply put and clear. Thank you for sharing. How do I release memory used by a pandas dataframe? and other issues with csv Python module was always my weak point 😁. Checked yesterday, it works!