Preheat the oven to 350°F. Lightly spray a 9x13-inch baking dish with nonstick cooking spray.
Add the bread and apples. Place 16 ounces cubed cinnamon swirl bread and 3 peeled, cored, and diced Granny Smith apples into the prepared baking dish. Gently toss to distribute the apples throughout the bread.
Make the custard. In a large bowl, whisk together 6 large eggs, 1 1/2 cups heavy whipping cream, 1/2 cup milk, 1 1/2 tablespoons cinnamon, 1/4 teaspoon nutmeg, 1/4 teaspoon cloves, 1/2 teaspoon salt, and 1 (14-ounce) can sweetened condensed milk until smooth and completely combined.
Pour the custard over the bread. Slowly pour the egg mixture evenly over the cinnamon bread and apples.
Soak the bread. Gently press the bread cubes into the custard so they are well coated and have a chance to absorb the liquid.
Bake at 350°F for 30 to 40 minutes. The center should begin to puff and the custard should be set. The bread pudding should still be soft and slightly gooey in the middle, but it should not be runny.
Serve warm. Let the bread pudding cool for a few minutes, then serve warm with vanilla ice cream, whipped cream, caramel sauce, or a drizzle of heavy cream.