Short answer
There is no term that describes a trend where a political party does worse in State elections when holding power Federally, because there isn't such a trend in the case of "all other things being equal".
Long answer
I have to disagree with the premise of your question (at least from the Australian perspective). That is, I disagree that the party that holds power at Federal level will - all other things being equal - tend to hold a disadvantage in State elections. [Bold emphasis mine]
Typically, the party that holds power federally will win some of the State or Territory elections that are held while it's in power federally, and it'll also lose some. The main differentiation gets down to local (i.e. State) politics/issues.
There may be a small disadvantage (particularly in the case of a very unpopular federal government), but this doesn't apply across the board in all States and Territories and is much more present in the case of by-elections by virtue of protest votes, although voters may use a State/Territory election to send a message to the Federal government if it's unpopular.
I've read the article you cite (The Cycles of Party Politics, April 2012) but don't see how this supports your assertion. Perhaps I've missed something?
In terms of the United States, the last 25 mid-term elections (including this week) show:
- There has been a split result in four mid-term elections (1930, 1982, 2010, 2018)
- The party holding the presidency won both houses of congress in 10 mid-term elections (1922, 1926, 1934, 1938, 1942, 1950, 1962, 1966, 1978, 2002)
- the party holding the presidency lost both houses of congress in 11 mid-term elections (1946, 1954, 1958, 1970, 1974, 1986, 1990, 1994, 1998, 2006, 2014)
So, in terms of actual seats in congress, there is no real trend - except perhaps the fact that there may be a trend in terms of a split result in Congress now being more likely (twice in past decade, but only four times in the past 100 years).
While I haven't looked at Gubernatorial elections specifically1, looking at the Senate results for the past 25 mid-terms shows us that the party holding the presidency has won the 'States House' (i.e. the Senate) in 12 mid-term elections (and lost it in 13), so this also doesn't denote a trend.
1. The issue of partisan Gerrymandering in a number of states means any such analysis of Gubernatorial elections is fraught with danger unless allowances are made on a state-by-state basis for the impact of any such gerrymandering.