You might have notices this behavior when you cut a selection or use the rubber tool.
The behavior depends on whether your images has an alpha channel.
You can add an alpha channel by choosing Layer → Transparency → Add alpha channel

Growing Rails Applications in Practice

Check out our e-book. Learn to structure large Ruby on Rails codebases with the tools you already know and love.

Gimp: Why removing pixels sometimes leaves transparency, sometimes the background color