The proposed video summarization technique is a step in the direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound)while reducing resource, storage and bandwidth requirements. We propose a new unsupervised reinforcement learning framework with novel rewards that facilitates unsupervised learning avoiding tedious and impractical manual labeling for summarizing ultrasound videos to enhance its utility as a triage tool in the emergency department(ED) and for use in telemedicine