Back to General and Gameplay Programming

Async IO issue on delete while file is loading

Rewaz · 2021-03-14T23:48:19

Hi guys, I'm having an issue with loading async files from disk. Let me give some context, code is in C++, I have 2 threads, main thread ( physic & render ) & IO thread ( in charge of loading files async ). Sometimes a request, while being loaded in the IO thread ( I'm using Windows API with ReadFileEx and SleepEx ), is removed from MainThread, causes the callback to fail. ( for example I moved too fast, and the loading request didn't finish, I was loading a texture, but the object is too far away from me, so I need to delete it ) I know one option is to not delete the request until read is done, but I don't like this approach because I don't like keeping objects with a pending request in a Update loop only checking if it was completed ( because I will need to implement that kinda Update check system for each class I create ). Another idea is to create a list of loaded files, which will be called with the render fn from MainThread. The list contains all the files already read from the IO thread, if the request was deleted I just simply delete the memory, if the request is still alive, I do the callback. The issue I saw in here is, what happen if I want to create a new thread, and I need to load any file from that new thread ( can be a task thread ), I would need to create a new list for that thread, and a function for it too. Any ideas, lib or code that I can check about this?

General and Gameplay Programming Programming C++ file

Started by Rewaz March 10, 2021 06:14 PM

11 comments, last by Rewaz 3 years, 8 months ago

Alberth

10,228

March 13, 2021 06:00 AM

If the variable is used in a single thread it's fine.

It seemed to me that the BlockComplete function and the while loop were in 2 different threads.

Sorry for the confusion.

Rewaz

Author

March 14, 2021 11:48 PM

Alberth said:
If the variable is used in a single thread it's fine.
It seemed to me that the BlockComplete function and the while loop were in 2 different threads.
Sorry for the confusion.

Don't worry xD.

I'm thinking, maybe using a shared_ptr I could share the instance that I want to the FileReader so it can callback, but I have a few custom allocators, some objects are created by PoolAllocator, so I don't know if I can use shared_ptr for that.

Async IO issue on delete while file is loading

This topic is closed to new replies.

Popular Topics

Recommended Tutorials

Async IO issue on delete while file is loading

This topic is closed to new replies.

Popular Topics

Recommended Tutorials

Reticulating splines