Jack Campbell made 27 saves for Toronto.
Dryden Hunt scored for New York, and Igor Shesterkin stopped 28 skote.
The Rangers came in with four straight victories, and had earned points in eight of their last nine, but were unable to generate much of an attack until the third period.
The Leafs have won five straight and are 10-1-0 since a four-game slide.
Shesterkin, who made 40 saves in New York’s 2-1 overtime victory at Toronto on Oct. 18, had a nice blocker stop on Jason Spezza early in the first period off a turnover, but Toronto pushed ahead moments later.
Rielly took a pass from Wayne Simmonds at the point and snapped a one-timer on Shesterkin with Michael Bunting providing a screen in front for the defenseman’s second goal of the season at 3:41.
Auston Matthews tested Shesterkin on a couple of chances midway through the second before Campbell denied Julien Gauthier at the other end.
Toronto got its first power-play opportunity a few minutes later, and after Campbell snagged Kevin Rooney’s chance on a 2-on-1 break, the Leafs connected on the man advantage for the 10th time their last 10 speletjies.
Rielly took a pass at the left point and was given acres of space by New York’s penalty killers before toe-dragging around Jacob Trouba and scoring his third — and third in four outings — at 10:59 of the second.
Campbell didn’t have a lot to do, but was sharp on an Artemi Panarin effort late in the period.
Hunt broke the shutout bid at 3:30 when he banged home a loose puck after Kaapo Kakko’s initial shot went off linemate Ryan Strome in front.
The Rangers continued to push, but Campbell was there at every turn, including a pad stop of Chris Kreider and a glove save on Trouba.
AANTEKENINGE: Rielly scored two goals in a game for the fourth time in his NHL career. … Former Toronto Blue Jays third baseman Josh Donaldson was in attendance.
The Rangers host Buffalo on Sunday.
The Leafs host Pittsburgh on Saturday to wrap up a stretch of nine of 11 games at home.