You can swipe an audio recording to reveal the delete button (much like Mail and many other apps).

Yes, we are working on landscape support and plan to support it in an upcoming version.