Infuse doesn't currently allow for folder deletions. However, if you are deleting a file that happens to be the last item in a folder, Infuse will remove the folder as well.
Hi, I found out about this after I deleted the file from infuse and lost folder full of documents because there was the last (only!) video file in it but also many other files not detected by infuse. Not cool. I suggest forbidding deletion of folder after deleting a file under any circumstances unless Infuse is certain the folder is truly empty (no files in it whatsoever).