Yes, you would just supply the appropriate CSS code to make this happen. If you are using the sidebarLayout form, you can add a scroll option to the sidebarPanel to start, something like:
sidebarPanel(id = "my_panel, style = "overflow-y:scroll;position:relative;max-height:600px",...
You may have to tweak based on your specific app, but the concept is the same