What ARIMA stands for
The video defines ARIMA as Auto Regressive Integrated Moving Average. AR and MA are treated as familiar from ARMA, while I is the added component that handles nonstationarity associated with a moving mean.
ritvikmath · YouTube · 9:25
This 120-second whiteboard clip introduces the ARIMA model in time series analysis through an anchor-sales example. The speaker explains that AR and MA are familiar from ARMA, while the extra I stands for Integrated. Using a plotted series with an upward-moving mean, the video states that AR, MA, and ARMA require stationarity, so a direct ARMA fit is inappropriate. The board then shows the transformation and a flatter lower graph to motivate how the Integrated component handles a moving mean before ARMA-style modeling. This 120-second whiteboard segment introduces the "Integrated" part of ARIMA by contrasting an original trending series with a differenced series . The speaker explicitly warns that "integrated" here does not mean calculus integration. Using an anchor-sales example, he explains that each new value is the change from one month to the next. The main intuition is that if the original series is approximately linear plus noise, then successive differences should fluctuate around a constant. The lower plot is then interpreted as having a constant mean over time, which the video presents as solving the non-stationarity problem, though without giving a formal definition of stationarity. This 120-second whiteboard segment introduces the ARIMA model through the concrete example ARIMA(1,1,1). The speaker first states informal prerequisites for using ARIMA, namely constant standard deviation over time and no seasonality. He then defines the three parameters p, d, q, contrasting ARIMA with ARMA by adding the integrated order d. The central method demonstrated is first differencing: the original series is replaced by , with a spoken note that second differencing is also possible. The board work culminates in the equation , and the speaker maps each piece to the AR part, MA part, and current error, explaining that the I part is encoded by modeling the differenced series rather than appearing as a separate additive term. This segment explains how to recover predictions for an original time series () after fitting an ARIMA model to its differenced version (). Using an example of predicting anchor sales, the speaker defines first-order differencing () and derives the inverse formula . This allows converting forecasted differences back into actual sales predictions by summing them with the last known observation. This 85-second whiteboard recap explains ARIMA as an ARMA model applied after differencing a time series. Using anchor sales as the example, the presenter defines first differences , shows a trending graph becoming a more stationary-looking graph, writes ARIMA(1,1,1) with p,d,q, and derives the recovery formula . The speaker emphasizes choosing the lowest differencing order that achieves stationarity and notes that p and q play the same AR and MA roles as in ARMA.
Use the learning inspector for key ideas and moments, or open the reading tabs for the complete notes.
Generated from the video's visuals and explanation; not verbatim speech.
The clip opens on a whiteboard titled ARIMA MODEL, with the acronym broken down on the left as Auto, Regressive, Integrated, Moving, Average. The speaker introduces ARIMA as a time series model and immediately frames the lesson around one question: if AR and MA are already known from ARMA, what does the I add?
To answer that, the speaker builds a concrete example. Monthly anchor sales are represented by , where t indexes months and the units are thousands. On the board, an anchor drawing is labeled = , and the upper graph plots against t. The orange curve rises overall while fluctuating, visually establishing a trend in the data.
The key obstacle is then stated explicitly: AR, MA, and ARMA models require stationarity. The speaker summarizes stationarity as constant mean, constant variance over time, and no seasonality. Since the plotted series has a mean that shifts upward in roughly linear fashion, it fails the constant-mean requirement, so a direct ARMA fit is ruled out.
This motivates the Integrated part of ARIMA. The speaker says ARIMA is used when a series looks stationary except for a moving mean. Between the two graphs, the board displays the transformation , and the lower graph labels the new series . Compared with the upper plot, the lower purple curve is flatter around a horizontal level, illustrating how differencing removes the trend so that ARMA-style modeling becomes plausible.
The segment opens on a whiteboard headed "ARIMA MODEL" with the acronym expanded down the left side as Auto Regressive Integrated Moving Average. The key immediate point is terminological: the speaker warns against reading "Integrated" as calculus integration. Instead, in this context it means working with differences of the time series rather than the raw series itself.
The board then makes that idea concrete with a transformation written between two graphs: . The upper graph represents the original series over time t, while the lower graph represents the new series . In words, each value of is obtained by subtracting one observation from the next observation in the original sequence.
To explain the indexing, the speaker uses the anchor-sales example shown by the anchor drawing labeled . If the original data count anchors sold in thousands by month, then one value of the differenced series is February minus January. This turns the abstract formula into a simple month-to-month change.
Next comes the motivation for doing this. The upper plot is described as approximately linear with noise around a trend. The speaker recalls a basic property of linear functions: moving one step forward changes the output by a constant amount. Therefore, if the original series is driven mainly by a linear trend, successive differences should no longer rise steadily; they should fluctuate around a constant level.
That intuition is then mapped onto the lower plot. The presenter points out that the series now hovers around a mean instead of trending upward, and near the end he draws a horizontal dashed line across the lower graph to mark that level. The spoken conclusion is that differencing has addressed the non-stationarity of the original example by producing a series with a constant mean over time.
A caution worth noting is that this clip gives an informal, example-driven argument rather than a full formal treatment of stationarity. It states the practical takeaway—differencing removes the visible trend—but it does not spell out the complete mathematical definition or all conditions required for stationarity.
The clip opens with an informal justification for using ARIMA: the speaker says the series has the same constant standard deviation over time and no seasonality, so ARIMA can be used with more confidence.
He then shifts from intuition to formal definition and announces that the basic example will be ARIMA(1,1,1).
On the board, ARIMA(1,1,1) is written together with p,d,q. The speaker contrasts this with ARMA, saying ARMA had two parameters, p and q, while ARIMA has three: p, d, and q.
The roles are assigned explicitly: p is the autoregressive order, q is the moving-average order, and d is the integrated order.
Next he explains what means in practice. The original series is replaced by the first difference , so the model will be built on the differenced series rather than on the raw level series.
He adds that one can go further and take a second difference, producing a new series , and even a third difference, though he says first differencing is often enough depending on the task.
The central equation is then constructed for the simplest case ARIMA(1,1,1). The left-hand side is , emphasizing that the prediction target is the differenced series.
Using the anchor-sales example, he says we are no longer predicting the anchors themselves but the change from one time point to the next.
The right-hand side is filled in term by term: is identified as the autoregressive part, as the moving-average part, and as the current error.
Finally, he clarifies the structure of the full equation : the AR and MA pieces appear explicitly as terms, while the integrated piece is represented by the fact that the modeled variable is already a difference of the original series.
The speaker begins by acknowledging the accuracy of the ARIMA model fitted to the differenced series . However, they immediately clarify the ultimate goal: predicting the actual series (e.g., anchor sales), not just the differences.
This sets up the core problem: how to invert the differencing transformation. The speaker establishes the notation, defining as the index of the last observed data point and as a future index for which we want a prediction .
The derivation starts by rearranging the definition of the first difference, , to express in terms of and . Substituting , we get .
The speaker then demonstrates a recursive substitution. By replacing with , the expression expands. Continuing this process backwards leads to a telescoping sum.
The final recovered formula is presented: . The speaker explains the limits of the summation, noting that it stops at because that is the last known actual value, making further recursion unnecessary.
The segment concludes by confirming that this formula successfully bridges the gap between the model's outputs (forecasts of ) and the desired real-world predictions (values of ), provided one has the forecasts for the intermediate differences and the last historical observation.
The clip opens on the lower-left recovery calculation. The board writes the target as , while the spoken phrase sounds like "a sub k"; the visible notation and anchor example support as the intended symbol. The displayed chain is . This is the inverse of first differencing: if , then adding past Z values to an initial reconstructs the level .
The camera reveals the full ARIMA board. The title reads "ARIMA MODEL," and the left margin spells the acronym as Auto Regressive Integrated Moving Average. A blue anchor drawing is labeled =, tying the abstract series to the example of anchor sales. The speaker's main point is that ARIMA is close to ARMA: the extra Integrated step handles a trend before the ARMA machinery is applied.
Two graphs make the transformation concrete. The upper orange curve, labeled , rises overall while fluctuating, representing a nonstationary trending series. A red arrow labeled points down to the lower pink curve, labeled , which oscillates around a horizontal level. The mathematical role of the picture is to show that first differencing removes the displayed linear trend and produces a series more suitable for ARMA modeling.
The speaker explains the middle parameter d in ARIMA(p,d,q). For , take first differences; for , take second differences. The practical criterion given is stationarity: choose the differencing order at which the transformed plot becomes stationary. If first differences are not enough, second or third differences can be tried, but the advice is to keep d as small as possible so the model remains simple.
The right side of the board specifies ARIMA(1,1,1) and writes p,d,q underneath. The equation is . Here is the differenced series, is the autoregressive part, is the moving-average error part, and is the current innovation. The speaker clarifies that changing p adds more AR lags and changing q adds more error lags, exactly as in an ARMA model.
The explanation returns to the lower-left formula. After forecasting or estimating the differenced values Z, the original time series is recovered by the reverse transformation . The closing remarks frame ARIMA as another expansion of time-series acronyms: AR and MA combine into ARMA, then the Integrated component produces ARIMA, with the speaker joking that more letters will be added later.
The video defines ARIMA as Auto Regressive Integrated Moving Average. AR and MA are treated as familiar from ARMA, while I is the added component that handles nonstationarity associated with a moving mean.
The speaker states that AR, MA, and ARMA models require stationarity. In the example, the series has an upward-shifting mean, so it violates the constant-mean condition and cannot be modeled directly with a straight ARMA approach.
ARIMA is introduced for situations where the series seems stationary except for a moving mean. The Integrated part is therefore presented as the mechanism that adapts ARMA methods to weakly nonstationary data.
The transformation from the original series to the flattened series is written as . This is the standard first difference, and the lower graph labeled visually suggests that the trend has been reduced.
In this clip, the word "Integrated" in ARIMA is explained as modeling differences of the original time series, not as integration from calculus. The board pairs the acronym with the explicit transformation between two plots, making the terminology concrete.
The new series is created by subtracting adjacent values of the original series . The speaker's month example identifies one value as the change from one month to the next, such as February minus January.
If the original series is approximately linear apart from noise, then each step forward changes the value by roughly a constant amount. Taking successive differences therefore removes the steady increase and leaves fluctuations around a constant level.
The lower plot of is interpreted as hovering around a constant mean, and the speaker says this solves the problem of the original series not being stationary. The visual dashed line emphasizes the stable level of the transformed series.
Before defining the model, the speaker says ARIMA is more appropriate when the series has constant standard deviation over time and no seasonality. This is presented verbally as a practical condition rather than as a formal theorem.
ARIMA extends ARMA by adding a third parameter d. In ARIMA(p,d,q), p is the autoregressive order, d is the integrated or differencing order, and q is the moving-average order. The clip's worked example is ARIMA(1,1,1).
When , the original level series is transformed into a new series by taking consecutive differences. The board writes this as , and the later ARIMA equation is expressed in terms of rather than .
If first differencing is insufficient, the differenced series can be differenced again. The speaker describes a second difference as and notes that third differences are possible, although first differencing often suffices depending on the task.
For the simplest example in the clip, the model for the differenced series is written as . This combines one AR lag, one MA lag, and the current error term.
In the displayed equation, is the autoregressive part, is the moving-average part, and is the current error. The integrated part is not a separate additive term; it is encoded by modeling the already-differenced series .
The specific ARIMA model shown operates on the differenced series . It predicts the current difference using the previous difference (), the previous error (), and a new random shock ().
Differencing calculates the change between consecutive time points. Here, is defined as the difference between the next value and the current value of the original series.
To predict the original series value at a future time , sum all predicted differences from time to and add the last observed actual value . This effectively integrates the forecasted changes back onto the known baseline.
Starting from , recursively substitute , and so on, until reaching . This creates a chain of additions where intermediate terms cancel out or accumulate into the final sum.
The video defines ARIMA by spelling the acronym on the left side of the board and contrasting it with ARMA. The added Integrated part is represented by differencing the original series before applying AR and MA terms.
The central transformation shown is . The upper graph of has an upward trend, while the lower graph of fluctuates around a level, illustrating removal of the trend.
For the displayed ARIMA(1,1,1), the model is written in terms of the differenced series . The parameter means one difference has been taken, gives one AR lag, and gives one MA error lag.
The speaker says the differencing order should be chosen when the time series becomes stationary. If first differences are not stationary, second or third differences may be tried, but the recommended practice is to keep the order as low as possible for simplicity.
Because is a first difference of , the original value is obtained by adding the initial value to all preceding differenced values. This is the reverse transformation written at the bottom left of the board.
The board uses a blue anchor labeled = and the speaker identifies as the number of anchors sold in time period k. The example demonstrates the full workflow: trend in sales, differencing, ARIMA(1,1,1) modeling, and recovery of sales levels.
Explore conditions, steps and evidence. Supplementary explanations are labeled separately from content shown in the video.
The speaker says the number of anchors sold every month is given by a variable a sub t.
The upper graph has vertical axis labeled and horizontal axis labeled t.
Number of anchors sold at time period t, in thousands.
t is the month or time period.
The speaker says t being the month or the time period you're in.
Both graphs use t as the horizontal-axis label.
t
Time index, specifically month or time period.
Discrete time periods in the example.
The lower graph has vertical axis labeled .
The displayed relation is .
Differenced series obtained from consecutive values of .
Defined by the displayed formula .
The speaker introduces the ARIMA model and later states that ARIMA stands for Auto Regressive Integrated Moving Average.
The title on the board reads ARIMA MODEL.
ARIMA
Auto Regressive Integrated Moving Average model.
Time series model class discussed in the clip.
The speaker asks what the I is doing here and later says the I stands for integrated.
The left-side acronym list shows I with the word Integrated written next to it.
I
Integrated component of ARIMA.
Part of the ARIMA acronym.
The speaker identifies AR as autoregressive.
The left-side list pairs A with Auto and R with Regressive.
AR
Auto Regressive part of the model name.
Component of ARMA/ARIMA naming.
The speaker identifies MA as moving average.
The left-side list pairs M with Moving and A with Average.
MA
Moving Average part of the model name.
Component of ARMA/ARIMA naming.
A partially visible formula on the right includes and an ellipsis.
The full formula is cut off and not fully legible.
The speaker does not explain this formula in the clip.
A coefficient appearing in a partially visible ARIMA-related formula on the right side of the board.
Only partially shown; full context unavailable in this clip.
A partially visible formula on the right includes and .
The full formula is cut off and not fully legible.
No spoken explanation of these symbols occurs in the clip.
Error or innovation term appearing in a partially visible formula on the right side of the board.
Only partially shown; full context unavailable in this clip.
Top center of the whiteboard shows the title "ARIMA MODEL".
ARIMA
Name of the time-series model being introduced; the left column expands it as Auto Regressive Integrated Moving Average.
Time series modeling notation
Upper right drawing is an anchor labeled "= ".
The speaker says the example concerns "the number of anchors sold in thousands".
Original time series value at time t, represented by the anchor drawing and used in the differencing formula.
Observed time index t; values are described verbally as numbers of anchors sold in thousands.
Between the two graphs the board shows "".
The speaker defines a new series as the difference from one timestamp to the previous timestamp.
Differenced time series obtained by subtracting the current original value from the next original value.
Time index t; constructed from consecutive q-values.
The speaker says they will talk about a model in time series analysis called the ARIMA model.
The board title reads ARIMA MODEL.
The clip introduces ARIMA as a time series model. The speaker notes that AR and MA are already familiar as autoregressive and moving average, and focuses on explaining the additional I component.
The discussion is within time series analysis.
The speaker says ARIMA stands for Auto Regressive Integrated Moving Average, and the I stands for integrated.
The left-side list spells out Auto, Regressive, Integrated, Moving, Average.
ARIMA is defined verbally and visually as Auto Regressive Integrated Moving Average. The new element relative to ARMA is the Integrated term, represented by I.
The speaker says AR, MA, or ARMA models require the time series to be stationary.
The speaker summarizes stationarity as needing constant mean, constant variance over time, and no seasonality.
The clip gives a summary rather than a formal definition.
The speaker says 'and so on,' indicating additional conditions are omitted.
The video states that AR, MA, and ARMA models require stationarity. In the spoken summary, stationarity means the series has constant mean, constant variance over time, and no seasonality.
Applies to AR, MA, and ARMA models according to the speaker.
The speaker says the series seems stationary except for a moving mean, so a straight ARMA model cannot be used.
The speaker says ARIMA is used in situations where things seem stationary except for a moving mean.
The Integrated part of ARIMA is presented as the mechanism for handling series that are otherwise suitable for ARMA modeling but have a nonconstant mean trend. The clip frames ARIMA as extending ARMA to such cases.
Used when the series appears stationary apart from a moving mean or trend.
Left column spells out "Auto", "Regressive", "Integrated", "Moving", "Average" under the title "ARIMA MODEL".
The speaker says, "Before you freak out thinking that we're talking about integrals here, integrated in this context just means that instead of predicting the time series itself, you're going to be predicting differences of the time series from one timestamp to the previous timestamp."
In this clip, "Integrated" does not refer to calculus integration. It refers to modeling differences of the original time series rather than the raw series itself. The board visually supports this by placing the differenced series below the original series and writing the transformation between them.
Applies to the ARIMA terminology as explained in this introductory segment.
The explanation is given at a high level rather than through formal theory.
The board shows "" between the upper and lower plots.
The speaker says, "We're gonna create a new time series called Z sub T, which is simply simply gonna be defined as A sub T plus one minus A sub T."
He then gives the example of February anchors minus January anchors to produce one point of the new series.
The spoken letter sounds like "A" while the written formula uses q; the visual formula is clearer and is taken as the board notation.
The video introduces a transformed series formed by taking successive differences of the original series. On the board this is written explicitly as , and the speaker explains it as subtracting the previous month's value from the current month's value to obtain one point of the new series.
Requires an ordered time series with values indexed by time.
The clip uses a concrete monthly example to explain adjacent-time differencing.
The speaker says the original series "seems to be pretty much linear" with noise around a linear trend.
He continues, "to get from one point of a linear function to the next, you just add some constant value," and therefore differences should hover around a constant.
The upper plot is drawn as an orange rising jagged line, visually consistent with a trend plus noise.
The clip motivates differencing by observing that the original series looks approximately linear apart from noise. For a linear function, moving one step forward changes the value by a constant amount, so taking successive differences should remove the trend and leave values fluctuating around a constant level.
The argument is presented intuitively for an approximately linear trend.
The video explicitly says it is not going deeply into theory here.
The speaker says, "So we've solved the problem of our time series not being stationary. Now it has a constant mean over time."
The lower plot is drawn as a pink jagged line oscillating around a horizontal level rather than rising.
Near the end, the presenter adds a horizontal dashed line across the lower plot to mark the level around which the differenced series hovers.
The clip states the conclusion verbally but does not define stationarity formally within this excerpt.
After explaining why differences of a linear trend should be roughly constant, the video concludes that the transformed series now has a constant mean over time and therefore is no longer non-stationary in the same way as the original trending series. The lower graph visually reinforces this by showing fluctuations around a stable level.
This is the video's high-level interpretation of the differenced plot.
Formal stationarity conditions are not spelled out in this clip.
The speaker defines ARIMA as having three parameters p, d, q, where p is AR order, q is MA order, and d is integrated order.
ARIMA(1,1,1) and p,d,q are written on the board.
An ARIMA model extends ARMA by adding a differencing order d. In the notation ARIMA(p,d,q), p is the autoregressive order, d is the integration or differencing order, and q is the moving-average order. The clip uses ARIMA(1,1,1) as the simplest example.
p is the order of the AR part
q is the order of the MA part
d is the order of the integrated part
the worked example in this clip is ,,
The speaker says means a difference one because they just took the first difference.
The board shows .
Taking the first difference replaces the original level series with a new series formed from consecutive differences. This is the integrated step corresponding to .
The original series is indexed by time
one difference is taken
this matches in ARIMA(1,1,1)
The speaker says you can instead want the second difference, creating a new series like , and you can do a third difference, though usually a first one suffices depending on the task.
No explicit formula for third differencing is written on the board.
If first differencing is not enough, the differenced series can itself be differenced again. The clip describes a second difference as forming , and notes that higher orders are possible but often unnecessary.
Applies after an initial differencing step
used when more differencing is needed
the speaker says usually first differencing suffices but it depends on the task
The speaker writes and explains the simplest form of ARIMA as 1,1,1 given by = phi_1 + theta_1 epsilon_{t-1} + epsilon_t.
The completed equation is visible on the board.
For the example ARIMA(1,1,1), the modeled differenced series equals an autoregressive term in the lagged differenced value plus a moving-average term in the lagged error plus the current error.
This is the specific ,, case
must already be the differenced series
the equation is written for the differenced variable, not the original level variable
The speaker says you can't just straight up use an AR or MA or even ARMA model here because those models all require the time series to be stationary.
The speaker says the mean is shifting upward in a linear fashion, so the straight ARMA model cannot be used.
The claim is stated informally rather than proved in this clip.
If a time series is not stationary, then AR, MA, and ARMA models cannot be applied directly to it.
The series under discussion has a nonconstant mean trend.
For the AR, MA, and ARMA models mentioned in the clip.
The speaker says you use the ARIMA model in situations like this where things seem like they're stationary except for a pesky moving mean.
This is a practical motivation statement, not a formal theorem.
ARIMA is appropriate in situations where a series looks stationary except for a moving mean.
The series otherwise satisfies the stationarity-like conditions discussed in the clip.
For situations of the type described by the speaker.
The speaker says that for a linear function, going from one point to the next adds a constant value, so the differences are always constant.
The statement is made informally for the plotted example rather than proved algebraically in this clip.
If a function is linear, then moving from one input to the next changes the output by a constant amount, so successive differences are constant.
The underlying trend is treated as linear.
Consecutive observations are taken at equal time steps.
For consecutive points of a linear function.
The speaker says that after taking differences, the series is expected to hover around some constant and that this solves the non-stationarity problem.
The lower plot shows the differenced series fluctuating around a level, and a dashed horizontal line is added near the end.
The clip presents this as an intuitive conclusion from the example, not as a general theorem with full assumptions.
For the example shown, differencing the original trending series produces a new series that hovers around a constant mean over time.
The original series has an approximately linear trend with noise.
The transformation is applied.
Stated for the illustrated time series example.
The speaker says the series has the same constant standard deviation over time and no seasonality, so they are free to use the ARIMA models with more confidence.
The clip gives this as a spoken precondition but does not formalize stationarity mathematically.
If the series has constant standard deviation over time and no seasonality, then the speaker treats ARIMA modeling as more appropriate.
constant standard deviation over time
no seasonality
For the series under discussion in this clip.
The speaker says in this case what we did was d equals one, a difference one, because we just took the first difference.
In the displayed ARIMA(1,1,1) example, corresponds to taking the first difference of the original series.
The model is ARIMA(1,1,1)
the series has been differenced once
For the example shown on the board.
Speaker says, "the ARIMA model is not that much crazier than just an ARMA model."
The board keeps the same ARMA-style structure after defining from .
In this presentation, ARIMA is described as essentially an ARMA model used after transforming a trending time series by differencing.
The time series has an obvious linear trend upward or downward.
The differenced series is the object to which the ARMA equation is applied.
For the ARIMA setup shown on the board.
Speaker says the choice of differencing is basically when the time series becomes stationary.
Speaker adds that if first differences are not stationary, one could try second or third differences, but typically keep the order as low as possible.
The clip does not define stationarity formally or specify a statistical test.
The differencing order d should be chosen so that the transformed time series becomes stationary, preferably using the lowest such order.
The modeler can inspect whether the differenced plot is stationary.
Higher differencing orders are available if lower ones do not produce stationarity.
Practical rule stated for choosing d in ARIMA modeling.
Speaker says changing p or q would be the same thing as an ARMA model.
Speaker says more lags in the AR part correspond to p and more error lags in the MA part correspond to q.
In the ARIMA model shown, p determines the number of autoregressive lags and q determines the number of moving-average error lags, just as in ARMA.
The series has already been differenced according to d.
For the AR and MA components of ARIMA(p,d,q).
The upper plot shows versus t with an upward-trending jagged orange line.
A downward arrow between plots is labeled .
The lower plot shows versus t with a flatter jagged purple line around a horizontal level.
The clip visually motivates the transformation but does not prove stationarity of .
Start with the original monthly sales series plotted against time.
This is the variable introduced by the speaker and labeled on the upper graph.
Form a new series by subtracting each value from the next value.
This relation is explicitly written on the board between the two graphs.
The resulting lower plot represents the transformed series.
The lower graph is labeled and is presented as the output of the displayed subtraction rule.
The clip uses the displayed formula to show how a trending series is converted into a flatter series , motivating the Integrated step before ARMA modeling.
The speaker moves from describing the original series as linear-with-noise to explaining constant increments of a linear function, then to the claim that differences hover around a constant.
The board contrasts an upper rising series with a lower fluctuating series linked by .
This is an intuitive derivation rather than a formal proof; no algebraic expansion of is shown on screen.
Observe that the original plotted series appears approximately linear apart from noise.
The speaker explicitly describes the upper series as "pretty much linear" with noise around a linear trend.
Recall that a linear function changes by a constant amount from one step to the next.
The speaker states that to get from one point of a linear function to the next, you add some constant value.
Apply successive differencing to the original series to form a new series.
This transformation is written on the board and described verbally as creating Z sub T from adjacent values.
Conclude that the differenced values should hover around a constant level rather than keep rising.
The speaker says that if we take the difference between one timestamp and the previous timestamp, we expect it to hover around some constant.
Interpret the lower plot as the transformed series and state that it now has a constant mean over time.
The speaker points to the lower plot and says, "So we've solved the problem of our time series not being stationary. Now it has a constant mean over time."
The clip's reasoning is that differencing removes the visible linear trend, leaving a series that fluctuates around a stable mean.
The speaker builds the equation term by term and identifies each part as AR, MA, or current error.
The board changes from blanks to = phi_1 + theta_1 epsilon_{t-1} + epsilon_t.
Start from the general parameter meaning of ARIMA(p,d,q): p controls the AR order, d controls differencing, and q controls the MA order.
Stated directly by the speaker when defining ARIMA(1,1,1).
Because , replace the original level series by its first difference and model that new series.
Spoken explanation plus the formula already written on the board.
Since , include one autoregressive lag term in the differenced series.
The speaker explicitly calls this the autoregressive bit.
Since , include one moving-average lag term in the error.
The speaker explicitly calls this the moving average bit.
Add the current-time error term to complete the model equation.
The speaker says we of course have our error in the current time period.
Combine the pieces into the full ARIMA(1,1,1) equation for the differenced series.
This is the final equation written on the board.
The clip derives the concrete ARIMA(1,1,1) model by applying first differencing and then adding one AR lag and one MA lag to the differenced series.
The step-by-step algebraic expansion is written on the bottom left of the board.
The speaker verbally walks through the substitution process: ' is equal to plus . We just keep going. is equal to plus ...'
Start with the definition of the first difference.
Definition of differencing shown on the board.
Rearrange the definition to solve for the next value of the original series.
Algebraic manipulation.
Substitute to express the target future value .
Application of the rearranged formula.
Substitute the expression for into the equation.
Recursive substitution.
Continue substituting backwards until reaching the last known observation . The sum collects all intermediate differenced terms.
Telescoping sum / recursive expansion.
The future value can be calculated as the sum of predicted differences down to plus the last observed actual value .
The lower-left derivation starts from and expands backward.
Speaker says that after doing the addition, we get the best guess for the original quantity at time k.
The board's definition is evaluated at .
Substitution into the displayed first-difference definition.
Rearrange the previous equation to solve for .
Algebraic rearrangement.
Apply the same relation to .
Repeated substitution using the first-difference identity.
Continue substituting backward until reaching the initial value .
Telescoping accumulation of first differences.
The original level is recovered by adding the initial value to the accumulated prior differenced values.
The speaker sets up a salesman of anchors who sells anchors per month, in thousands.
An anchor drawing is labeled = .
The upper graph shows versus t with an upward trend.
The board displays and a lower graph labeled .
No numerical data values are provided.
The clip does not complete a forecast calculation.
A salesman wants to predict next month's anchor sales from past monthly sales data.
Monthly anchor sales are denoted .
t is the month or time period.
Sales are measured in thousands.
The plotted series has an upward linear-looking trend.
Explain why a direct ARMA approach is unsuitable and how the Integrated idea addresses the trend.
Plot historical monthly sales against time.
The speaker describes making a chart with time on the x-axis and anchors sold on the y-axis.
Recognize that the series has a moving mean.
The speaker explicitly says the mean is shifting upward in a linear fashion.
Conclude that a straight ARMA model cannot be used directly.
The speaker states that AR, MA, and ARMA models require stationarity.
Introduce a differenced series to remove the trend.
This formula is written on the board between the two graphs.
Use the Integrated component to handle the moving mean before applying ARMA-style modeling.
The speaker says ARIMA is used in situations where the series seems stationary except for a moving mean.
The example motivates ARIMA as ARMA plus an integration/differencing step for nonstationary series with a moving mean.
The verification is visual: the lower plot appears flatter than the upper plot, supporting the stated purpose of differencing, though no formal test is shown.
The speaker says, "So basically it's taking your number of anchors sold in thousands at some month, let's say February, minus the number of anchors sold in thousands from the previous month, say January."
The anchor drawing labeled ties the symbolic series to the verbal example.
No numerical values are provided, only the conceptual month-to-month subtraction.
Explain what one value of the new differenced series represents in the anchor-sales example.
The original series counts anchors sold in thousands at each month.
The transformation is .
Identify how a single value is produced from adjacent months.
Use the board formula for the transformed series.
The formula is written directly between the two graphs.
Substitute the verbal example: February value minus January value gives one point of the new series.
The speaker explicitly describes February anchors minus January anchors as producing one time point of .
One value of is the change in anchor sales from one month to the next, e.g. February minus January.
The answer matches both the written formula and the spoken month-to-month example.
The speaker refers to anchor sales and says we are no longer trying to predict your anchors but rather the difference between your anchor sales from one time point to the last.
An anchor drawing labeled appears beside the ARIMA notation.
is written on the board.
The numerical values of the anchor-sales series are never given.
Use an anchor-sales series to illustrate how ARIMA(1,1,1) is set up after differencing.
Original series denoted
first difference defined as
model order chosen as ARIMA(1,1,1)
Express the forecasting target and write the corresponding ARIMA(1,1,1) equation for the differenced series.
Replace the original level series by its first difference.
This is the step explained by the speaker.
Write the ARIMA(1,1,1) model for the differenced series using one AR lag, one MA lag, and the current error.
This is the equation completed on the board and verbally unpacked term by term.
The example models the differenced anchor-sales series with .
The speaker verifies the setup by pointing out which term is AR, which is MA, and how the integrated part is represented by modeling rather than .
The speaker uses the example: 'we want to predict how many anchors are expected to sell next month.'
An anchor icon is drawn on the top right, labeled '= '.
Given historical sales data of anchors (, ..., ) and an ARIMA(1,1,1) model fitted to the differenced sales data (), predict the number of anchors to be sold at a future time k.
Historical series , , ..., .
ARIMA(1,1,1) model for .
Target time index .
Calculate the predicted value .
Use the historical data to estimate parameters , and generate forecasts for future z values.
Standard ARIMA modeling procedure implied by the context.
Generate predictions for the differenced series up to time k-1.
Required inputs for the recovery formula.
Sum the forecasted differences and add the last actual observation .
Derived method for inverting differencing.
The predicted number of anchors sold at time k is .
Check that if , the formula reduces to , which matches the definition of the difference.
Speaker identifies as the number of anchors sold in time period k.
A blue anchor drawing is labeled =.
The board uses , , and ARIMA(1,1,1) throughout the anchor-sales example.
No numerical data values are given, so no numeric forecast is computed.
Model a time series of anchor sales that has a visible trend by differencing it, fitting an ARIMA(1,1,1)-style equation to the differenced series, and recovering forecasts for original sales.
denotes anchors sold at time t.
The plotted series has an upward linear trend with fluctuations.
is the first-difference series.
The displayed model is ARIMA(1,1,1): .
Explain how ARIMA handles the trending anchor-sales series and how to recover from modeled differences.
Convert the trending original series into a differenced series.
The video states first differences are used when the series has an obvious linear trend.
Apply an ARMA-type equation to the differenced series.
This is the displayed ARIMA(1,1,1) equation.
Recover the original sales level by cumulatively adding predicted differences to .
This is the reverse transformation written on the board.
The anchor-sales example yields a conceptual forecast procedure: difference the trending sales series, model the differences with ARIMA(1,1,1), then sum predicted differences back onto the initial sales value.
The recovery formula follows algebraically from ; no numerical verification is present in the clip.
Two stacked coordinate graphs are drawn on the left half of the board.
The upper vertical axis is labeled , the lower vertical axis is labeled , and both horizontal axes are labeled t.
A downward arrow between them is labeled .
Upper graph with axis labels and t
Orange upward-trending jagged line
Downward arrow labeled
Lower graph with axis labels and t
Purple flatter jagged line
The presentation moves conceptually from the upper series to the lower series via the displayed subtraction formula.
Both graphs share the same horizontal time axis label t.
The board layout remains fixed throughout the clip.
The visual contrast between the upper trending plot and the lower flatter plot illustrates the effect of first differencing.
A blue anchor drawing appears at the top right with = beside it.
The speaker says the number of anchors sold every month is given by a variable a sub t.
Blue anchor drawing
Label =
The anchor image is used to identify the quantity being modeled.
The anchor symbol consistently represents the monthly sales variable .
The drawing provides a concrete mnemonic for the abstract time-series variable.
The left side lists A Auto, R Regressive, I Integrated, M Moving, A Average.
The speaker explains AR and MA and later says I stands for integrated.
Vertical letter list A R I M A
Corresponding words Auto, Regressive, Integrated, Moving, Average
The spoken explanation aligns the letters with their expanded terms.
The acronym order remains A-R-I-M-A throughout.
The list visually decomposes ARIMA into its constituent model components.
The whiteboard is organized into a left acronym column, a central pair of graphs, and a right-side ARIMA formula area.
The upper graph is labeled on the vertical axis and t on the horizontal axis; the lower graph is labeled and t.
A downward arrow between the graphs is annotated with .
Upper orange rising jagged plot labeled versus t
Lower pink fluctuating plot labeled versus t
Downward transformation arrow with
Right-side anchor drawing and partial ARIMA notation
The presenter repeatedly points first to the upper trending plot and then to the lower differenced plot.
Near the end, a horizontal dashed line is added across the lower plot to indicate the level around which fluctuates.
The upper plot consistently represents the original series with an upward trend.
The lower plot consistently represents the transformed series after differencing.
The formula remains the explicit link between the two plots.
The visual layout teaches that ARIMA's "Integrated" part means replacing the raw series by its successive differences, and that the lower plot is meant to look more stable than the upper one.
At about 01:52 the presenter says he will use a different color and draws a horizontal dashed line across the lower graph.
He says the values "nicely hover around some mean."
The exact numerical level of the dashed line is not labeled.
Lower plot
Horizontal dashed line
A new dashed horizontal line is drawn through the lower plot after the verbal discussion of hovering around a mean.
The lower plot still represents .
The line is horizontal, indicating a constant level rather than a trend.
The dashed line visually marks the constant mean that the speaker claims the differenced series now has.
The board is divided into a left acronym column, a center pair of time-series plots, and a right ARIMA notation block with an anchor drawing.
Visible text includes ARIMA MODEL, Auto Regressive Integrated Moving Average, ARIMA(1,1,1), p,d,q, and the equation being filled in.
Title ARIMA MODEL
acronym list Auto / Regressive / Integrated / Moving / Average
upper plot labeled versus t
lower plot labeled versus t
anchor drawing labeled
right-side notation ARIMA(1,1,1) with p,d,q
equation area for = ...
The right-side ARIMA notation is completed from ARIMA( , , ) to ARIMA(1,1,1).
p,d,q is written beneath the ARIMA notation.
The equation is filled in from blanks to = phi_1 + theta_1 epsilon_{t-1} + epsilon_t.
The speaker's hand points among the acronym, the plots, and the equation terms as each role is explained.
The upper plot consistently represents the original series .
The lower plot consistently represents the differenced series .
The anchor drawing continues to symbolize the original level series .
The visual arrangement links the acronym ARIMA to three ideas: the original series, its differenced version, and the final model equation built from AR and MA terms.
Two coordinate plots are stacked vertically, with on top and below, connected by the formula .
Exact numerical scales on the axes are not legible.
Upper time-series plot of
Lower time-series plot of
Downward arrow between the plots
Formula
The explanation moves conceptually from the upper original series to the lower transformed series.
The lower plot is used to motivate why the model equation is written in terms of .
Both plots share the same horizontal time axis t.
The transformation relation between them remains .
The diagram shows that ARIMA modeling in this example is applied after transforming the original series into a differenced series.
Two coordinate systems are drawn. Top: axes labeled vs t with an orange jagged line trending upwards. Bottom: axes labeled vs t with a pink jagged line oscillating around zero.
The speaker's hand points to the top graph when discussing and the bottom graph when discussing .
Top graph (Original series )
Bottom graph (Differenced series )
Anchor icon
Speaker highlights different parts of the graphs during explanation.
Relative positions of the two graphs.
Labels of the axes.
The visual contrast illustrates the effect of differencing: transforming a trending series () into a stationary, mean-zero series () suitable for ARIMA modeling.
The speaker writes the recovery derivation step-by-step at the bottom of the paper.
Hand holding marker
Paper surface
Equation is written.
Equation extends to ... = .
Final summation form is completed.
Location of the writing area (bottom left).
Visualizes the recursive substitution process used to derive the inverse differencing formula.
The camera reveals the full whiteboard with title, acronym list, two graphs, equations, recovery formula, and anchor drawing.
Title "ARIMA MODEL"
Left acronym list: Auto, Regressive, Integrated, Moving, Average
Upper graph of
Lower graph of
Right-side ARIMA(1,1,1) equation block
Lower-left recovery formula
Blue anchor labeled =
The hand points to different parts of the board as the speaker recaps differencing, stationarity, p,d,q, and recovery.
The board content remains the same throughout the clip.
The upper series is consistently labeled and the lower transformed series is labeled .
The visual organization separates the original trending series, the differenced stationary-looking series, the ARMA equation applied to differences, and the inverse transformation back to levels.
The upper orange line trends upward with jagged fluctuations; the lower pink line fluctuates around a horizontal level.
A red downward arrow between the graphs is labeled .
Speaker says ARIMA is used when the time series has an obvious linear trend upward or downward.
Orange curve
Pink curve
Red transformation arrow
Horizontal t-axis labels
The visual emphasis moves from the upper trending curve to the lower transformed curve.
Both plots share the same conceptual time axis t.
The transformation label remains .
The diagram illustrates that differencing removes the displayed linear trend, leaving a series that the speaker associates with stationarity.
The hand points to ARIMA(1,1,1), p,d,q, the AR term, and the MA/error term while the speaker discusses d, p, and q.
Speaker explains first versus second differences and says p and q behave like ARMA lags.
ARIMA(1,1,1)
p,d,q
The finger moves from the middle parameter d to the surrounding p and q terms and then to the equation components.
The equation remains .
The gesture links the abstract orders p,d,q to concrete roles: d selects differencing, p selects AR lags, and q selects MA error lags.
The speaker warns that you can't just straight up use an AR or MA or even ARMA model here because those models all require the time series to be stationary.
One might try to use AR, MA, or ARMA directly on a series whose mean is shifting upward.
The clip states that these models require stationarity, so a series with a moving mean needs the Integrated step before ARMA-style modeling.
The speaker asks what the I is doing here and later answers that it stands for integrated.
The speaker connects the I to handling a moving mean.
The I may seem like just another letter in the acronym without functional meaning.
In this clip, I is explained as Integrated and is tied to dealing with a nonstationary moving mean.
The speaker explicitly warns, "Before you freak out thinking that we're talking about integrals here..."
The left column lists "Integrated" as part of ARIMA, while the central formula shows differencing rather than integration.
The word "Integrated" in ARIMA might be taken to mean integral calculus.
In this clip, "Integrated" means modeling differences of the time series, specifically forming from adjacent q-values, not computing integrals.
The speaker says the differenced series is no longer non-stationary and has a constant mean over time.
The lower plot is shown fluctuating around a horizontal dashed line.
This caution is added by the analyst because the clip does not provide the full formal definition of stationarity.
One might infer from this excerpt that constant mean alone is the complete definition of stationarity.
The video only argues informally that differencing removes the visible trend and yields a constant mean; it does not state the full mathematical conditions for stationarity in this segment.
The speaker contrasts ARMA, which had two parameters p and q, with ARIMA, which has three parameters p, d, and q.
One might think ARIMA uses the same two-parameter structure as ARMA.
The clip explicitly adds a third parameter d for the integrated or differencing order, so ARIMA(p,d,q) has one more structural parameter than ARMA(p,q).
The speaker says the I bit is taken care of by the fact that is a difference between consecutive time points of the series we originally started with.
One might expect the I in ARIMA to appear as another separate term in the equation.
In this example, the integrated part is implemented by modeling the differenced series rather than by adding a distinct I-term to the right-hand side.
The speaker says: 'Of course, we don't really want in the end to predict the difference, but we want to predict how many anchors are expected to sell next month. So the actual series.'
Believing that the output of the ARIMA model (predictions of ) is the final desired forecast.
The ARIMA model predicts the differences (). To get the forecast for the actual series (), one must apply the recovery formula (inverse differencing) by summing the predicted differences and adding the last known actual value.
Speaker says one could try a second or third difference, but typically you want to stick with as low of an order as possible to keep your model simple.
If first differencing does not immediately look perfectly stationary, one might think a higher difference order should always be used.
The video advises using the lowest differencing order that makes the series stationary, because lower order keeps the model simple.
Speaker says ARIMA is not that much crazier than ARMA and is used when the series has a linear trend.
The board applies the same ARMA-style equation to after defining .
ARIMA may be mistaken for a completely different model from ARMA.
In this clip, ARIMA is presented as ARMA applied to a differenced series, with the integrated step handling trend.
The speaker says most letters are recognized as the autoregressive moving average model, then asks what the I is doing here.
The speaker later says ARIMA stands for Auto Regressive Integrated Moving Average.
The clip presents ARIMA as built from the familiar AR and MA parts plus an additional Integrated part.
The speaker says AR/MA/ARMA require stationarity and then says ARIMA is used when there is a moving mean.
Understanding why ARMA cannot be used directly on a nonstationary series motivates the role of the Integrated component in ARIMA.
The board shows between the two graphs.
The speaker explains that ARIMA handles a moving mean.
The clip does not explicitly say the word differencing, although the displayed formula is the standard first difference.
The Integrated idea is illustrated by the displayed transformation from to using successive differences.
The speaker defines "integrated" as predicting differences of the time series.
The board writes directly under the ARIMA heading.
The clip explains the "Integrated" component of ARIMA by introducing the differenced series .
The speaker first motivates differencing via the linear trend and then concludes that the transformed series has a constant mean.
The upper trending plot is contrasted with the lower plot around a dashed horizontal line.
The intuition that differences of a linear trend are constant is applied to justify treating the differenced series as stationary-looking.
The board places above and below with the transformation formula between them.
The visual comparison contrasts the original trending series with the differenced series , which is presented as fluctuating around a constant level.
The speaker says ARMA had two parameters, p and q, while ARIMA has three parameters, p, d, and q.
The clip presents ARIMA as extending the two-parameter ARMA structure by adding the differencing order d, then instantiates that generalized structure as ARIMA(1,1,1).
The speaker first explains via first differencing and then writes the model for .
appears before the full ARIMA(1,1,1) equation.
The ARIMA(1,1,1) equation is written for the differenced series, so understanding first differencing is required before interpreting the equation.
The speaker points to individual terms and names them as the AR bit, the MA bit, and the current error.
The full equation contains distinct AR, MA, and current-error pieces, and the clip decomposes it into those components.
The speaker contrasts doing a first difference with optionally taking a second difference , and even a third difference.
First differencing is the case shown in the example, while second and higher differencing are extensions obtained by differencing the already-differenced series.
The board links the definition directly to the ARIMA equation for .
Differencing is applied to the original series to create the stationary series , which is then modeled using ARIMA.
The recovery formula is derived directly from the definition of the difference.
The recovery method is the mathematical inverse of the differencing operation, allowing translation of forecasts back to the original scale.
The speaker asks what the I is doing here and later says it stands for integrated.
The speaker says AR, MA, and ARMA require stationarity and the example series has a moving mean.
The board displays .
The speaker uses an anchor salesman example with monthly sales .
The speaker directly addresses the possible confusion with integrals.
The board explicitly shows .
The speaker explains constant increments of a linear function and their consequences for differencing.
The speaker says the differenced series now has a constant mean over time.
A dashed horizontal line is drawn on the lower plot.
The speaker gives the February-minus-January anchor-sales example.
The speaker says d is the order of the integrated part and that means a first difference.
The speaker explicitly compares ARMA's two parameters with ARIMA's three parameters.
The completed equation = phi_1 + theta_1 epsilon_{t-1} + epsilon_t is shown.
Covered · Introduction of ARIMA and focus on the unfamiliar I component.
Covered · Anchor-sales setup and description of the plotted series versus t.
Covered · Explanation that AR/MA/ARMA need stationarity and why the trending example fails that condition.
Covered · ARIMA is introduced as the remedy for a moving mean, and the board formula illustrates the Integrated step.
Covered · Title, acronym expansion, and clarification that "Integrated" refers to differencing rather than calculus.
Covered · Definition of and the month-to-month anchor-sales example.
Covered · High-level motivation based on an approximately linear trend and constant increments.
Covered · Conclusion that the differenced series hovers around a constant mean, reinforced by the lower plot and dashed line.
Covered · Audio states constant standard deviation and no seasonality as reasons to use ARIMA with more confidence.
Covered · Speaker defines ARIMA(1,1,1) and the roles of p, d, q while writing the notation on the board.
Covered · Speaker explains first differencing and the possibility of second or third differencing.
Covered · The ARIMA(1,1,1) equation is completed and each term is identified as AR, MA, or current error.
Covered · Only a brief transition phrase is audible at the end; no new mathematical content is introduced in this interval.
Covered · Full segment covers the motivation for recovering the original series, the definition of differencing, the step-by-step derivation of the recovery formula, and its application to the anchor sales example.
Covered · Opening close-up shows the recovery formula while the speaker describes obtaining the best guess for .
Covered · Full board appears; speaker introduces ARIMA as ARMA plus differencing for trending series.
Covered · Speaker explains first, second, and higher differences and choosing the lowest stationary order.
Covered · Speaker relates p and q to AR lags and MA error lags in the displayed equation.
Covered · Speaker returns to reverse transformation and closes with a recap of the expanding time-series acronyms.
Reviewed subject paths
The in ARIMA(p,d,q) represents the order of differencing, also known as the integrated component. It indicates how many times the original series has been differenced to achieve stationarity.
Conditions: The model is denoted as ARIMA(p,d,q).; is a non-negative integer.
You would use a second difference if the first differenced series is still not stationary. The goal is to choose the lowest differencing order that makes the series stationary.
Conditions: The original series is non-stationary.; First differencing () does not result in a stationary series.; The modeler can inspect the stationarity of the differenced plots.
You recover the original series by summing the predicted differences and adding them to the last known actual value (or depending on the starting index). The formula is .
Conditions: You have forecasts for the differenced series .; You know the last observed value of the original series .; The relationship holds.
ARMA models require the time series to be stationary. A series with an upward trend has a moving mean, which violates the stationarity condition of having a constant mean over time.
Conditions: The model class is AR, MA, or ARMA.; The series exhibits a non-constant mean (trend).
The equation for ARIMA(1,1,1) is , where is the differenced series, is the autoregressive coefficient, is the moving-average coefficient, and is the error term.
Conditions: The model is ARIMA(1,1,1).; is the first difference of the original series .; .
The I in ARIMA stands for Integrated. It is implemented by modeling the differences of the original time series rather than the raw series itself.
Conditions: The context is the ARIMA time series model.; The explanation refers to the specific ARIMA(1,1,1) example shown on the board.
Differencing helps because for a linear function, the change from one point to the next is constant. By taking successive differences, the linear trend is removed, leaving a series that fluctuates around a constant mean, which satisfies the stationarity requirement for ARMA models.
Conditions: The original series has an approximately linear trend with noise.; The goal is to achieve stationarity for modeling.
The differenced series is defined as the difference between the next value of the original series and the current value. Mathematically, it is expressed as .
Conditions: The original series is indexed by time .; The values represent observations at discrete time points (e.g., months).