If you're on Ubuntu:
sudo apt-get install ruby-dev
Rails LTS provides security patches for old versions of Ruby on Rails (2.3, 3.2, 4.2 and 5.2)
On other platforms: Look for a package containing ruby header files. On Red Hat that's "ruby-devel" likely.