Preheat the oven to 425°F (220°C) and line a baking sheet with parchment paper.
Wash and dry the baby potatoes thoroughly. Carefully make thin slices across each potato, stopping just before cutting all the way through.
Place the potatoes on the prepared baking sheet and brush with olive oil.
Sprinkle with garlic powder, paprika, salt, and black pepper.
Bake for 35–40 minutes or until the potatoes are crispy on the edges and tender in the center.
Remove from the oven and sprinkle shredded cheddar cheese over each potato.
Return to the oven for 3–5 minutes until the cheese is melted and bubbly.
Top with crumbled bacon and sliced green onions.
Serve warm with a dollop of sour cream.