Replay-and-Forget-Free Graph Class-Incremental Learning: A Task Profiling and Prompting Approach

Class-incremental learning (CIL) aims to continually learn a sequence of tasks, with each task consisting of a set of unique classes. Graph CIL (GCIL) follows the same setting but needs to deal with graph tasks (e.g., node classification in a graph). The key characteristic of CIL lies in the absence of task identifiers (IDs) during inference, which causes a significant challenge in separating classes from different tasks (i.e., inter-task class separation). Being able to accurately predict the task IDs can help address this issue, but it is a challenging problem. In this paper, we show theoretically that accurate task ID prediction on graph data can be achieved by a Laplacian smoothing-based graph task profiling approach, in which each graph task is modeled by a task prototype based on Laplacian smoothing over the graph. It guarantees that the task prototypes of the same graph task are nearly the same with a large smoothing step, while those of different tasks are distinct due to differences in graph structure and node attributes. Further, to avoid the catastrophic forgetting of the knowledge learned in previous graph tasks, we propose a novel graph prompting approach for GCIL which learns a small discriminative graph prompt for each task, essentially resulting in a separate classification model for each task. The prompt learning requires the training of a single graph neural network (GNN) only once on the first task, and no data replay is required thereafter, thereby obtaining a GCIL model being both replay-free and forget-free. Extensive experiments on four GCIL benchmarks show that i) our task prototype-based method can achieve 100% task ID prediction accuracy on all four datasets, ii) our GCIL model significantly outperforms state-of-the-art competing methods by at least 18% in average CIL accuracy, and iii) our model is fully free of forgetting on the four datasets.

Paper

Similar papers

Peer review

Reviewer aHCQ7/10 · confidence 5/52024-06-26

Summary

- The paper tackles the problem of graph class-incremental learning. The proposed TPP consists of two modules, that is, task profiling and graph prompting. - The task prediction is accomplished by learning task prototypes based on graph Laplacian smoothing. Specifically, task profiling aims to accurately predict the task ID of each task during inference by constructing Laplacian smoothing-based task prototypes. - Graph prompting aims to capture task-specific knowledge into graph prompts. Graph prompting is to avoid the catastrophic forgetting of the knowledge learned in previous graph tasks, which learns a small discriminative graph prompt for each task. - TPP shows significant performance improvements, as demonstrated by experiments on four graph datasets.

Strengths

- The idea of using Laplacian smoothing to predict the task IDs and graph prompts to capture task-specific knowledge is interesting and new in graph class-incremental learning. - The proposed method, TPP, is novel, which not only predicts the task IDs of test graph tasks but also distills task-specific information into prompts. - The proposed method is both replay-free and forget-free and requires the training of a single GNN only once. - The task IDs of each graph task can be accurately predicted with theoretical support. - The paper is clearly motivated and well-written.

Weaknesses

- The task prediction relies on the graph transduction setting. The paper focuses on the subgraph incremental learning without considering the inter-edges between graph tasks, resulting in the proposed method not generalizable to other settings effectively. - Not clear definitions of different categories of methods for graph continual learning. The authors argue that graph prompting can reduce the heavy burdens on optimization and storage with the increasing number of tasks compared to training a separate GNN for each task. However, there are no empirical comparisons. - Some ablation studies are missing.

Questions

- The authors should point out the key differences of task prediction between image and graph more clearly. - The authors should include the comparisons between graph prompting and training separate GNNs for each task. Can the proposed task identification method be used for other domains like continual image classification? Since the authors argue that graph prompting can reduce the heavy burdens on optimization and storage compared to training a separate GNN for each task, the authors should include the comparisons between graph prompting and training separate GNNs for each task. - In Table 3, why is the performance of TPP without task prediction significantly low as the graph prompts learn task-specific knowledge? - In Fig. 4(a), the performance of TPP becomes stable when the size of the graph prompts is larger than one. The authors should provide a more detailed analysis on this phenomenon. The task prediction relies on the graph transduction setting and the accuracy of task prediction with training nodes can also achieve very high accuracy as shown in Fig. 4(b). Therefore, the task identification can be simply conducted by averaging all the node features as the task prototypes. The authors should compare the proposed method with this approach. - The authors are encouraged to include clear definitions of three categories of methods for graph continual learning to make the paper more comprehensive. Besides, the descriptions of the baselines should be also included.

Rating

7

Confidence

5

Soundness

3

Presentation

3

Contribution

3

Limitations

Yes, they addresed.

Reviewer j8FV5/10 · confidence 3/52024-07-11

Summary

This paper addresses the challenge of class-incremental learning (CIL) in graph data (GCIL) by proposing a novel Task Profiling and Prompting (TPP) approach. It leverages Laplacian smoothing-based task profiling to achieve accurate task ID prediction, thereby mitigating inter-task class separation issues, and introduces a graph prompting method to prevent catastrophic forgetting without the need for data replay. Extensive experiments on four benchmarks demonstrate that TPP achieves 100% task ID prediction accuracy and significantly outperforms state-of-the-art methods in average CIL accuracy while being fully forget-free.

Strengths

- This paper highlights the significant challenge in graph class incremental learning (GCIL). - It introduces a novel approach in GCIL, task ID prediction, by devising Laplacian smoothing-based task profiling for graph task ID prediction, which shows surprisingly perfect performance. - Furthermore, extensive experiments are conducted to demonstrate the superiority of the proposed method.

Weaknesses

- The proposed graph prompting method appears to merely apply the technique from [1] to the graph domain, lacking technical novelty. - The proposed TP method raises several significant concerns: - The proposed TP method consists of Laplacian smoothing and average pooling without any training. Since Laplacian smoothing and GCN are significantly similar, there is no clear reason why the GCN-based OOD detector (in OODCIL) should underperform compared to the proposed TP. I kindly ask the authors to compare the performance of the GCN-based OOD detector and provide an explanation of the results, with exact numerical values rather than charts. For a similar reason, I do not understand why OODCIL significantly underperforms compared to most baselines. Therefore, please provide the following two sets of results: 1) replacing the task ID prediction module in OODCIL with TP, and 2) replacing the task ID prediction module in TPP with the OOD detector from OODCIL. - The zero AF scores indicate that the proposed TP perfectly classifies the task ID, which raises suspicions about the task formulation. Specifically, I suspect that each task was formulated in a way that gives TPP an advantage, making it easier to predict the task ID. Therefore, I kindly ask the authors to provide experiments under different task formulations, such as: 1) randomly sampling classes for each task, and 2) splitting the classes in numerical order by the given class number (e.g., (0,1), (2,3), (4,5),...,) and so on. - The absence of available source code to verify the results amplifies my suspicions about the experimental results. - In Theorems 1 and 2, the authors assume a sufficiently large number of Laplacian smoothing steps (i.e., $s \rightarrow \infty$). However, this assumption seems flawed because, as $s$ increases, the prototype will collapse due to the oversmoothing problem, making each task indiscriminative. Furthermore, the authors set the value of $s$ to 3 in their experimetns, which is far from a sufficiently large number of steps. I kindly ask the authors to provide experimental results for the accuracy of the task ID prediction module with the value of $s$ varying from {3, 5, 7, ...}. These results should demonstrate that as $s$ increases, the accuracy should increase as well. [1] Learning to Prompt for Continual Learning, CVPR 2022

Questions

See Weaknesses

Rating

5

Confidence

3

Soundness

1

Presentation

3

Contribution

2

Limitations

The authors addressed the limitations.

Authorsrebuttal2024-08-12

Thank you so much for the insightful comment. The source code of TPP is provided at https://anonymous.4open.science/r/TPP-1B07/README.md, where we provide the implementations of TPP and OODCIL in "Baselines/tpp\_model" and "Baselines/ood\_model" respectively. To explain why the proposed prototype-based methods can achieve higher task prediction accuracy than the OOD-based method, we'd like to clarify the key differences between them despite they share similar neighborhood aggregation strategies. Given a sequence of connected graphs (tasks) $(\mathcal{G}^1, \ldots, \mathcal{G}^T)$, where each task contains a set of unique $C$ classes of graph data, TPP constructs task prototypes for each task at its training stage, denoted as $\mathcal{P} = (\mathbf{p}^1,\ldots,\mathbf{p}^T)$. During inference, the prototype $\mathbf{p}^{\text{test}}$ for the test task is constructed, and task prediction is performed by identifying the most similar prototype in $\mathcal{P}$. Note that **this process in TPP does NOT involve any training and data reply**. Despite the simplicity, the prototype-based task prediction can achieve surprisingly good performance. This is attributed to the discrimination of the graph structure and node attributes between different tasks, as shown in Figure 3 in the paper. **Different from our training-free and reply-free method, OODCIL requires training an OOD detector for each task using data from the current task as in-distribution (ID) data and the rehearsal data from the other tasks as OOD data, and it then utilizes the OOD score to perform task prediction**. This means there are $T$ OOD detectors after learning $T$ tasks. During inference, a test graph is fed into all the $T$ detectors that obtain an OOD score for each task, and the test graph is predicted to belong to the task with the lowest OOD score. Specifically, let $f_o^t(\cdot)$ be an OOD detector trained for task $t$ and there will be $T$ detectors: $(\{ f_o^1(\cdot), \ldots, f_o^T(\cdot)\})$ after sequentially learning $T$ tasks. Then, for a test graph $\mathcal{G}^{\text{test}}$, ideally, the learned OOD detector $f_o^t(\cdot)$ should yield the lowest OOD score if $\mathcal{G}^{\text{test}}$ comes from task $t$ and output a high OOD score if otherwise. To endow OOD detector $f_o^t(\cdot)$ with such an ability, the ideal case is that we have ID data from task $t$ and the OOD data from all other tasks. However, due to the sequential emergence of graph tasks and the restriction of access to previous tasks, we treat the current graph at task $t$ as ID data and construct the OOD data by a data replay approach (i.e., sampling subgraphs from all previous $t-1$ tasks) in our experiments. The detector $f_o^t(\cdot)$ is then optimized to perform a $(C+1)$-way classification, where the first $C$ entries of the classification probabilities are for ID classes at task $t$ and the $(C+1)$-th probability output is used to define the OOD score. However, the OOD detector $f_o^t(\cdot)$ can get only limited access to the graph data from all $(t-1)$ previous tasks (i.e., having access to the replay data only). Moreover, when training $f_o^t(\cdot)$, we also do not have any access to graph data of unseen task $j\in(t, T]$. Thus, *due to the lack of sufficient training samples for seen tasks and the absence of the samples of unseen task $j$*, the trained $f_o^t(\cdot)$ can yield a lower score for the task $j$ than the OOD score yielded by $f_o^j(\cdot)$. This means that $f_o^j(\cdot)$ can often produce a lower OOD score for task $j$ than for the other tasks, but the lowest OOD score yielded by $f_o^j(\cdot)$ is still smaller than the OOD score yielded by the other detectors for the same task $j$, leading to incorrect task prediction. For example, in Table A4 below, the OOD score for task 3 yielded by $f_o^1(\cdot)$ is lower than that yielded by $f_o^3(\cdot)$ (note that task $3$ has the lowest OOD score among the OOD scores yielded by $f_o^3(\cdot)$), and the OOD scores for task 4 and task 5 yielded by $f_o^1(\cdot)$ is lower than that yielded by $f_o^4(\cdot)$ and $f_o^5(\cdot)$ respectively. As a result, the OOD scores yielded by OOD detectors trained at earlier tasks are generally very low, e.g., the OOD scores in columns "$f_o^1(\cdot)$" and "$f_o^2(\cdot)$" in Table A4, leading to incorrect prediction of the tasks 3, 4 and 5 to be task 1. ``` Table A4. OOD scores of each test task which are yielded by all OOD detectors on the Arxiv dataset with 5 tasks. The test graph is predicted to be the task ID whose OOD detector yields the smallest OOD score. ``` |Test Graph|$f_o^1$|$f_o^2$|$f_o^3$|$f_o^4$|$f_o^5$| |---|---|---|---|---|---| |Task 1|**0.08**|0.92|0.90|0.89|0.94| |Task 2|0.16|**0.07**|0.86|0.87|0.89| |Task 3|**0.13**|0.31|0.17|0.92|0.85| |Task 4|**0.16**|0.42|0.82|0.34|0.96| |Task 5|**0.10**|0.37|0.48|0.93|0.29|

Authorsrebuttal2024-08-12

These two adverse effects lead to inaccurate task prediction of the OOD score-based approach, much less accurate than the proposed prototype-based approach (please see Table A5). This is mainly due to the fact that i) its training has a strong reliance on sufficient OOD data from the tasks other than the current task and ii) this training performance (or the access to other task data) is largely restricted due to the CIL nature. Designing an effective OOD detector for graph data has not been explored in the literature. It is challenging due to the limited access to OOD data. If we continuously update the OOD detector, we will need to handle catastrophic forgetting problem with the OOD detector and its interference with the CIL classifiers as well. So, in this work, we implement a simple approach for OOD detectors, but we agree that it is an important problem for GCIL. ``` Table A5. Task prediction accuracy of three different methods. ``` |Method|CoraFull|Arxiv|Reddit|Products| |---|---|---|---|---| |Laplacian Smoothing|100|100|100|100| |Node Attributes|97.14|100|100|95.65| |OOD|62.86|10.00|80.00|78.26| Besides, the reason for GraphPrompt+OOD barely working is that GraphPrompt+OOD has significantly fewer learnable parameters than OODCIL, which leads to less accurate node classification per task. Combined with less inaccurate task prediction by the OOD detection method, the overall CIL performance is remarkably degraded. We very much hope the source code and our responses have addressed your concerns. We're more than happy to take any further questions if otherwise. Please kindly advise. Thank you very much! Best regards, Authors of Paper 8497

Authorsrebuttal2024-08-13

Dear Reviewer j8FV, We have provided detailed replies and newly added empirical results to address your concerns on why the OOD detection method are not as effective as our proposed prototype-based task prediction method. Per your request, we have also released our codes through an anonymous GitHub repository. Could you please kindly check whether they are helpful for answering your questions? We're ready to take any further questions you might have.

Reviewer j8FV2024-08-14

I have carefully reviewed the code and verified the 100% accuracy of task ID prediction. I appreciate your effort, and most of my concerns have been addressed. As a result, I will be raising my score.

Authorsrebuttal2024-08-14

Dear Reviewer j8FV, Thank you so much for your time and great support on verifying our code and the task ID prediction accuracy, and for the increase to an acceptance score. We're very pleased to know that our response has addressed most of your concerns. Please kindly let us know if there are any further questions.

Reviewer odiT5/10 · confidence 3/52024-07-12

Summary

This paper studies the graph class-incremental learning problem with unknown task identities. Specifically, the unknown task identity is the key challenge, and this work proposes a Laplacian smoothing-based graph task profiling approach that is theoretically justified capable of predicting the task identities. Besides, the forgetting problem is alleviated through a graph prompting approach. This approach learns a graph prompt for each task, such that the classification models for different tasks are separated. The experiments are conducted on four datasets.

Strengths

The proposed method can achieve 100% task identification accuracy. Theoretical analysis is also provided for the proposed method. The proposed method is compared against multiple SOTA baselines and obtains consistent performance improvement.

Weaknesses

The experimental setup is not introduced with details. The introduction on the background is not clear enough. For example, what is the relationship between identifying the tasks and overcoming the forgetting problem. Is recognizing the tasks correctly enough for avoiding the forgetting problem.

Questions

1. How are the datasets split into different tasks? Will different splitting strategy affect the performance? 2. What is the relationship between identifying the tasks and overcoming the forgetting problem. Is recognizing the tasks correctly enough for avoiding the forgetting problem.

Rating

5

Confidence

3

Soundness

3

Presentation

2

Contribution

3

Limitations

As mentioned by the authors, the main limitation of the work is the limited representative capacity and generalizability of the GNN backbone model in prompting.

Reviewer 4w4P5/10 · confidence 4/52024-07-14

Summary

The paper proposes a Replay-and-Forget-Free Graph Class-Incremental Learning (GCIL) approach called Task Profiling and Prompting (TPP). This method addresses the challenges of class-incremental learning in graph tasks without relying on task identifiers during inference. By using Laplacian smoothing-based task profiling for accurate task ID prediction and a novel graph prompting approach, TPP eliminates catastrophic forgetting and improves classification accuracy across multiple tasks.

Strengths

- The problem of obtaining a GCIL model being both replay-free and forget-free is interesting. - The presented empirical results are good. - The theoretical analysis is interesting.

Weaknesses

- Although CIL problem is interesting, the problem definition in Section 3.1 requires some clarification. Are there any real setting that a sequence of connected graphs (tasks) appear during training, these graphs may be the same but the target tasks are different? Besides, during testing, why a GCIL model is required to classify a test instance into one of all the T × C classes? Should it be firstly identify its tasks (1 of T), then assign to C classes? - Likewise, the datasets used in experiments, have been applied for routine scenarios. Why they should be considered into GCIL setting?

Questions

- Why "Despite being only learned on G1, f(·) can effectively adapt to all subsequent tasks with graph prompts" as written on line 228-229? Will this lead to high fluctuation if we choose different G1? Could the authors provide some empirical results on that? Please also check my comments above.

Rating

5

Confidence

4

Soundness

2

Presentation

3

Contribution

2

Limitations

NA

Reviewer j8FV2024-08-10

I appreciate the thorough response of the authors. However, I'm still suspicious about your task prediction performance. Specifically, the authors claimed that "given a test sample, TP explicitly predicts the task ID by finding the most similar prototype while OODCIL relies on the OOD score to predict the task probability. As a result, the task prediction of OODCIL heavily relies on the performance of the detector." However, this explanation does not fully address my concerns. The proposed TP is essentially a neighborhood normalized aggregation using their raw node features. On the other hand, the GCN-based OOD detector includes a GCN encoder that functions similarly through neighborhood aggregation. Moreover, the GCN encoder is trained specifically to discriminate between the current task and other tasks—a step that the proposed TP lacks. Therefore, it remains unclear to me why TP significantly outperforms the GCN-based OOD detectors by such a wide margin. The results presented in the third row of Table A1 (i.e., GraphPrompt + OOD) seem particularly questionable, as the performance is inexplicably low (nearly equivalent to that of a random classifier). The authors should clarify and convince readers of the specific factors that enable TP to outperform a seemingly similar approach (GCN-based OOD detector) so dramatically. My skepticism is further heightened by the results in Table A3. For the Arxiv and Reddit datasets, the performance reaches "100%" accuracy without any Laplacian steps, which implies that simply utilizing node features can perfectly discriminate between tasks. In other words, task prediction appears to be an exceptionally easy problem that can be fully resolved by merely calculating the similarity of raw node features. If that is the case, why does the GCN-based OOD detector struggle with such an apparently straightforward problem? In summary, I still have significant concerns regarding the perfect performance reported for the proposed TP: What specific factors allow the proposed TP to significantly outperform the GCN-based OOD detector? How does the method achieve perfect prediction performance by merely using raw node features and their prototypes for similarity search? Given these concerns, I strongly urge the authors to provide the source code, as it is the most effective way to address these issues. I am very open to discussing these concerns further with the authors. Best regards, Reviewer j8FV

Program Chairsdecision2024-09-25

Decision

Accept (poster)

© 2026 NYSGPT2525 LLC