diff --git a/CHANGELOG.md b/CHANGELOG.md
index 615c616f..63eb4c45 100644
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -18,6 +18,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
 ### Changed
 
 - Changed a workflow of Encoder's `na_forward` method resulting in performance boost ([#364](https://github.com/pyg-team/pytorch-frame/pull/364))
+- Removed ReLU applied in `FCResidualBlock` ([#368](https://github.com/pyg-team/pytorch-frame/pull/368))
 
 ### Deprecated
 
diff --git a/torch_frame/nn/models/resnet.py b/torch_frame/nn/models/resnet.py
index 07e10294..33737bc6 100644
--- a/torch_frame/nn/models/resnet.py
+++ b/torch_frame/nn/models/resnet.py
@@ -92,7 +92,6 @@ def forward(self, x: Tensor) -> Tensor:
             x = self.shortcut(x)
 
         out = out + x
-        out = self.relu(out)
 
         return out