Yep, so by definition if your input (higher wage) increases while your total output stays the same, then the ratio once divided shows productivity per unit has decreased, as OP said.
The input is not the cost of the hours worked, but the number of hours worked. Essentially, productivity measures the number of items a worker can produce per hour worked. Wage or cost doesn’t enter the equation.